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This  report  describes  the  status  of  research  being  performed 
for  the  Advanced  Research  Projects  Agency  Human  Resources 
Research  Office  on  development  of  techniques  of  event  analysis 
and  short  term  forecasting  and  their  application  within  the 
national  security  community.  Tie  report  describes  accomplish- 
ments for  the  period  15  September  1974  through  15  March  1975. 

The  work  reported  herein  is  principally  concerned  with  the 
development  and  analysis  of  multiple  data  stream  techniques 
and  techniques  of  forecasting  by  quantitative  analogies.  The 
work  builds  on  prior  research  devoted  to  the  coding  and  collec- 
tion of  event  data  and  the  development  of  quantitative  indica- 
tors for  defense  analysis.  The  continuing  objective  of  all 
research  has  been  to  develop  event  analysis  to  the  point  where 
it  can  be  useful  to  the  national  security  community  as  a 
means  for  systematically  recording,  analyzing  and  forecasting 
significant  international  phenomena. 

The  work  should  be  of  interest  to  all  agencies  involved  with 
the  management  of  foreign  affairs  and  national  security  programs 


SUMMARY 


P RO J F. C T OBJ E C TIVES 


The  objectives  of  the  research  reported  here  are  the  development 
of  new  techniques  for  event  data  analysis  and  for  short  term 


forecasting,  plus  demonstration  of  the  utility  of  such  techniques 
as  they  might  be  applied  to  problems  of  national  security  concern. 


The  new  technique  for  event  data  analysis  involves  the  treatment 
of  public  news  media  sources  of  different  national  origins  as 
reflecting  the  perceptions,  interests  and  viewpoints  of  the  orig- 
inating countries.  We  term  this  approach  multiple  data  stream 
analysis.  It  is  contended  that  similarities  and  differences 
present  in  such  media  sources  are  indicative  of  official  national 
similarities  and  differences,  and  therefore,  can  provide  insight 
into  present  and  prospective  international  behavior  patterns. 
Specifically,  it  is  assumed  throughout  that  countries  act  on  the 
basis  of  their  own  views  rather  than  on  the  basis  of  any  other 
reality.  Therefore,  we  are  well  advised  to  identify  the  views 
of  others  as  a means  of  anticipating  the  nature  of  their  ongoing 
international  participation.  While  the  use  of  public  media  views 
as  surrogates  for  official  views  must  always  be  with  caution,  it 
is  the  purpose  of  this  research  to  illustrate  the  kinds  of  unique 
information  such  an  approach  may  provide  on  selected  matters  of 
national  security  concern. 


The  new  technique  for  short  term  forecasting  is  based  on  the 
development  of  quantitative  historical  patterns  to  permit  the 


LEvent  data  analysis  T^fer.  to  the  quantitative  ®f 

international  behavior  as  expressed  in  terms  of  the  ' 

or  events,  that  are  recorded  as  occurring  between  and 

countries . 


forecast  outcome  of  a current  situation  to  be  a function  of 
the  outcome  of  its  most  similar  past  analogue.  This  form  of 
forecasting  is  often  used  subjectively.  In  quantitative  form, 
however,  history  constitutes  large,  samples,  permitting  forecast 
outcomes  to  be  represented  probabilistically.  The  implications 
of  this  approach  to  the  DoD  and  intelligence  communities  lie  in 
the  potential  ability  to  classify  a current  situation  according 
to  the  past  patterns  it  most  closely  resembles  and  to  supplement 
that  classification  with  probabilistic  estimates  of  the  likely 


outcome  in  prospect. 


MULTIPLE  DATA  STREAM  ANALYSIS  (MDS) 


The  MDS  research  reported  here  is  based  on  the  use  of  two  public 
media  sources,  the  daily  New  York  Times  ( N YT ) and  The  Times  of 
London  (TOL) . These  sources  were  selected  because  they  had  pre- 
viously been  subjected  to  event  data  coding,  thus  requiring  no 
further  data  development  for  ;roject  purposes.  Data  were  avail- 
able for  both  sources  for  the  36  month  period  July  1971  through 
June  1974.  A series  of  comparative  analyses  were  performed 
variously  employing  frequency  distributions  of  the  raw  event 


data,  summary  indicators  which  depict  the  friendliness  to  hos- 
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tility  of  international  behavior,  and  English  language  ab- 
stracts of  the  events  which  are  prepared  in  the  process  of  event 
coding.  Comparative  analyses  were  performed  to  answer  a series 
of  research  questions.  The  findings  illustrate  the  inferences 
regarding  similarities  and  differences  in  national  interests, 
attention,  and  points  of  view  which  may  be  derived  from  multiple 


data  streams. 


The  research  questions  are  stated  below,  each  followed  by  a 


summary 


of  findings.  The  findings  are  couched  in  terms  of  US 


1See  Appendix  B for  the  definition  and  measurement  of  these 
summary  indicators. 


'Detailed  findings  appear  i 


n "MDS  Findings",  pp.  6-51 


* • .“Tv 


and  UK  international  behavior.  It  should  be  emphasized,  however, 
that  the  findings  are  in  fact  US  and  UK  behavior  as  deduced  from 
reports  in  NYT  and  TOL . 


What  were  the  US  and  UK  views  of  overall  international 
affairs  between  mid-19,71  and  mid-1974? 


The  US  viewed  this  period  as  one  of  increasing  international 
activity  and  declining  animosity,  apparently  because  of  the 
emphasis  on  reconcil iation  with  China,  detente  with  the  USSR, 
and  extrication  of  the  US  from  combat  in  South  East  Asia.  The 
UK  did  not  consider  this  period  atypical  in  activity  or  hos- 
tility, until  the  Yom  Kippur  War  and  Oil  Embargo.  Following 
these  episodes  the  UK  view  of  international  affairs  was  substan- 
tially more  negative  than  that  of  the  US. 


What  regions,  countries  and  country  pairs  drew  the 
interest  and  attention  of  US  and  UK  during  this 
period? 


Geographic  considerations  appeared  to  dominate  differing  re 
gional  distributions  of  US  and  UK  actions  toward  the  world. 

Europe  was  the  paramount  target  of  UK  while  Asia  was  paramount 
to  the  US.  However,  strategic  and  historical  considerations 
appeared  to  be  present  as  well.  For  example,  within  Europe, 
the  US  directed  about  twice  as  much  attention  to  the  USSR  as 
did  the  UK.  Conv  rsely,  within  Asia  the  UK  directed  about  twice 
as  much  attention  to  its  former  colonies  as  did  the  US.  Overall, 
the  priorities  of  interests  of  the  two  countries  as  expressed 
by  their  actions  during  this  period  appeared  to  be  quite  dif- 
ferent. 
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On  the  othe»  hand,  with  regard  to  following  the  actions  of 
other  countries  and  interactions  between  other  pairs  of  coun- 
tries, the  US  and  UK  manifested  a generally  similar  pattern  of 
attention.  Both  countries  concentrated  attention  on  and  between 
countries  which  are  major  world  powers  and/or  were  directly  or 
indirectly  involved  in  conflict  situations. 


How  did  US  and  UK  view  the  friendliness  to  hostility 
of  actions  flowing  from  each  other  to  third  countries 
and  from  third  countr'  is  toward  each  other? 


In  this  analysis,  the  principal  acting  country,  either  US  or 
UK,  was  assumed  to  represent  its  own  actions  accurately.  The 
other  principal,  as  an  "observer",  was  assumed  to  "misinterpret" 
if  its  reports  did  not  reflect  a degree  of  friendliness  or  hos- 
tility similar  to  that  of  the  actor.  Similarly,  as  recipients 
of  the  actions  of  third  countries,  the  principals'  views  were 
assumed  accurate  and  the  observers'  either  similar  or  a mis- 
interpretation . 


The  findings  indicated  correspondence  between  the  views  of  US 
and  UK  in  79%  of  all  cases  examined.  Interestingly,  however, 
the  misinterpretation  that  existed  in  the  remaining  cases  tended 
to  be  large  (17%  of  the  cases)  rather  than  small  (6%  of  the  cases) 
The  implication  is  that  different  interpretations  form  the  founda- 
tions for  subsequent  actions  between  the  principal  countries  and 
from  them  toward  others.  To  the  extent  that  their  views  differ, 
so  may  their  future  behavior--even  if  they  are  otherwise  simi- 
larly disposed  toward  the  issues  involved. 
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What  were  the  US  and  UK  views  of  the  friendliness 
to  hostility  of  their  own  interaction  during  this 
period? 


In  this  analysis,  the  Policy  Style  measure  was  employed  to 
indicate  the  quality  of  actions  initiated  and  received  between 
the  principal  countries,  US  and  UK,  over  the  36  month  time 
period.  This  case  is  unique  in  that  US  and  UK  are  the  countries 
of  origin  of  the  two  media  sources  employed.  It  was  therefore 
treated  in  greater  detail  than  any  other,  being  considered  il- 
lustrative of  the  kinds  of  analyses  possible  were  MDS  tech- 
niques extended  to  additional  sources  representing  other  countries 

The  initial  finding  was  that  both  US  and  UK  viewed  their  Policy 
Styles  toward  one  another  similarly  over  the  36  months.  However, 
during  portions  of  the  overall  period  a counter-intuitive  lead  ~ 
Hag  relationship  was  evident,  i.e.,  the  target  country  seemingly 
anticipated  the  actor  country's  Policy  Style  toward  itself.  In 
examining  this  in  detail,  it  was  found  that  these  temporary  lead 
lag  phenomena  were  related  to  the  differing  presence  of  and  em- 
phasis given  to  specific  subjects  in  the  interaction  of  the  pair, 
as  viewed  by  each  party.  Since  it  was  also  found  that  the  style, 
or  quality  of  interaction,  on  each  subject  was  similarly  viewed 
by  both  parties,  it  was  evident  that  different  subject  emphasis 
was  the  basis  of  the  leads  and  lags.  Further,  it  was  during 
periods  when  attention  to  subjects  equalized  that  the  lead-lag 
phenomenon  disappeared.  Some  further  evidence  was  developed 
showing  that  the  Style  of  the  country  emphasizing  higher  level 
bureaucratic  actions  (policy  initiating  actions)  on  a subject 
leads  the  Style  of  the  country  emphasizing  lower  level  bureau- 
cratic actions  (policy  implementing  actions)  on  the  subject. 


What  were  the  US  and  UK  views  of  the  friendliness 
to  hostility  of  their  own  interaction  during  this 
period? 

In  this  analysis,  the  Policy  Style  measure'*'  wa  j employed  to 
indicate  the  quality  of  actions  initiated  and  received  between 
the  principal  countries,  US  and  UK,  over  the  36  month  time 
period.  This  case  is  unique  in  that  US  and  UK  are  the  countries 
of  origin  of  the  two  media  sources  employed.  It  was  therefore 
treated  in  greater  detail  than  any  other,  being  considered  il- 
lustrative of  the  kinds  of  analyses  possible  were  MDS  tech- 
niques extended  to  additional  sources  representing  other  countries. 

The  initial  finding  was  that  both  US  and  UK  viewed  their  Policy 
Styles  toward  one  another  similarly  over  the  36  months.  However, 
during  portions  or  the  overall  period  a counter-intuitive  lead 
lag  relationship  was  evident,  i.e.,  the  target  country  seemingly 
anticipated  the  actor  country's  Policy  Style  toward  itself.  In 
examining  this  in  detail,  it  was  found  that  these  temporary  lead 
lag  phenomena  were  related  to  the  differing  presence  of  and  em- 
phasis given  to  specific  subjects  in  the  interaction  of  the  pair, 
as  viewed  by  each  party.  Since  it  was  also  found  that  the  style, 
or  quality  of  interaction,  on  each  subject  was  similarly  viewed 
by  both  parties,  it  was  evident  that  different  subject  emphasis 
was  the  basis  of  the  leads  and  lags.  Further,  it  was  during 
periods  when  attention  to  subjects  equalized  that  the  lead-lag 
phenomenon  disappeared.  Some  further  evidence  was  developed 
showing  that  the  Style  of  the  country  emphasizing  higher  level 
bureaucratic  actions  (policy  initiating  actions)  on  a subject 
leads  the  Style  of  the  country  emphasizing  lower  level  bureau- 
cratic actions  (policy  implementing  actions)  on  the  subject. 


The  implications  of  these  MDS  findings  are  that  lead-lag  phenom- 
ena in  the  quality  of  a relationship  are  subject  and,  perhaps, 
bureaucracy  related,  and  tend  to  be  transitory.  This  phenomenon 
and  its  explanation,  however,  does  provide  guidance  as  to  how 
MDS  analysis  between  principal  countries  might  be  used  predic- 
tively  in  the  short  term. 


How  did  the  US  and  UK  view  the  friendliness  to 
hostility  between  other  pairs  of  countries  during 
this  period? 


With  respect  to  the  interaction  of  other  pairs  of  countries 
(e.g.,  USSR  and  China),  both  US  and  UK  are  observers.  We  wish 
to  ascertain  how  similar  or  different  are  US  and  UK  views  of 
such  pairs  in  order  to  compare  their  current  assessment  and  to 
anticipate  their  future  behavior  toward  situations  evolving 
between  other  countries. 

US  and  UK  views  of  Relations  between  eight  country  pairs  over 
time  were  employed  as  cases  in  this  analysis.  The  country  pairs 
selected  were  those  manifesting  armed  conflict  during  che  period 
under  examination  and/or  having  an  ongoing  history  of  hostility. 

For  the  entire  time  period,  for  six  of  the  eight  cases,  close 
correspondence  was  found  between  the  inferred  US  and  UK  assess- 
ments, and  lack  of  correspondence  was  not  unreasonably  large 
for  the  other  two  cases. 

During  various  segments  of  the  total  time  period,  however,  there 
were  seemingly  different  assessments  in  three  of  the  eight  cases 
As  in  the  case  of  the  US-UK  analysis,  it  is  in  identifying  these 
short  term  incongruencies  where  the  MDS  approach  may  prove  most 
useful,  if  our  assumption  is  correct  that  a country's  future 
actions  are  based  on  the  reality  of  its  own  current  views. 

For  example,  prior  to  the  Yom  Kippur  War,  UK  viewed  Relations 
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between  Israel  and  Egypt  as  improving  while  the  US  viewed  their 
Relations  as  declining  steadily.  Apart  from  the  fact  that  in 
this  instance,  the  US  view  was  a better  predictor  of  what  fol- 
lowed, the  UK  apparently  viewed  the  evolving  situation  as  less 
urgent.  Under  such  circumstances  would  UK  act  in  concert  with 
the  US  to  avert  or  manage  a crisis  it  did  not  view  as  immi  lent? 
Incongruence  in  views,  therefore,  signal  the  need  and  provide 
the  opportunity  to  review  a situation  in  detail  prior  to  rather 
than  after  !he  fact  of  crises. 


What  were  the  alignments  between  US  and  UK  toward 
other  countries  during  this  time  period? 
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In  this  analysis,  the  Alignment  of  US  and  UK  toward  another 
country  was  measured  as  the  difference  between  their  Policy 
Styles  toward  that  country.  Alignment  is  most  properly  mea- 
sured by  the  differing  quality  of  actions  each  country  reports 
it  initiated  toward  another  country.  We  term  this  the  signalled 
Alignment.  Additionally  there  are  the  US  and  UK  views  of  Align- 
ment which  are  based  on  their  own  reported  actions  and  their 
observations  of  actions  initiated  by  the  other.  The  signalled 
Alignment  can  be  considered  to  be  truer  and  can  be  contrasted 
with  separate  US  and  UK  views. 

Because  of  the  generally  similar  international  positions  of  US 
and  UK,  their  signalled  Alignments  in  75%  of  the  21  cases  ex- 
amined tended  to  be  close  to  very  close.  Of  greater  importance, 
however,  are  cases  where  the  US  and  UK  views  of  Alignment  differ 
even  though  the  signalled  Alignment  is  close.  For  example,  the 
US  viewed  UK  behavior  toward  France  as  much  more  friendly  than 
its  own,  while  the  UK  view  was  just  the  opposite.  This  type  of 
finding  further  emphasizes  a previously  stated  implication. 

Where  views  differ,  so  may  the  subsequent  behavior  of  the  prin- 
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cipals  involved,  if  they  act  ir  accord  with  their  own  reality. 
Through  MDS  techniques,  monitoring  for  incongruencies  between 
views  can  help  identify  possible  areas  of  future  policy  dif- 
ferences which  may  be  detrimental  to  US  national  security 
interests. 


SHORT  TERM  FORECASTING  RESEARCH 


In  previous  ARPA  supported  research,  preliminary  progress  was 
achieved  in  adapting  the  subjective  technique  of  forecasting 
by  historical  analogy  into  quantitative  terms.  Previous  results 
showed  that  five  patterns  could  be  deduced  from  time  series 
histories  of  the  Relations  (R)  and  Policy  Style  (S)  measures 
for  large  samples  of  country  pairs,  and  that  each  of  these 
patterns  was  associated  with  a subsequent  two  year  change  ( AR 
or  As)  which  was  significantly  different  from  the  overall  dis- 
tributions of  changes  across  the  entire  samples. 

The  Ar  and  As  distributions  were  proposed  as  probability  dis- 
tributions useful  for  forecasting  future  two-year  changes  in 
R and  S for  cases  currently  conforming  to  any  of  the  five  patterns. 
However,  it  was  proposed  that  these  distributions  be  used  as 
forecasts  only  in  the  absence  of  more  specific  information,  or 
as  a supplement  to  such  information,  just  as  the  subjective 
technique  from  which  it  is  adapted  is  used.  The  present  re- 
search is  intended  to  replicate  and  extend  earlier  findings,  to 
assess  the  validity  of  forecasts  based  on  the  quantitative  anal- 
ogies, and  to  demonstrate  utility.  Research  questions  which 
have  been  addressed  thus  far  are  stated  below  along  with  a 
summary  of  the  findings  related  to  each.''' 


''Detailed  findings  appear  in  "Findings",  pp . 55-71. 
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How  representative  was  the  distribution  of  changes 
in  Relations  ( Ar)  in  the  original  research  sample? 


The  original  experimental  case  sample  (Sample  1)  was  not  ran- 
domly selected,  but  consisted  only  of  pairs  of  individual  coun- 
tries and,  for  those  pairs,  was  limited  to  Ar  values  for  one 
two-year  time  period.  Two  additional  samples  were,  therefore, 
prepared.  Sample  2 consisted  of  all  two  year  Ar  values  for  the 
original  sample  of  74  country  pairs.  Sample  3 consisted  of  69 
pairs  including  country  groups  (e.g.,  Relations  between  USSR 
and  NATO)  and  issues  within  country  pairs  (e.g.,  Military  Re- 
lations between  USSR  and  China),  but  like  Sample  1 , Ar  values 
were  limited  to  one  time  period. 

It  was  found  that  the  di s tributions  o f Ar  for  Samples  1 and  2 
were  virtually  identical.  This  suggests  that  the  original 
(Sample  1)  Ar  distribution  is  representative  of  the  universe  of 
Ar  distributions  across  all  time  periods  for  country  pairs. 
Sample  3,  however,  differed  somewhat  from  Samples  1 and  2, 
suggesting  that  Ar  distributions  associated  with  Relations  for 
pairs  other  then  country  pairs  may  reflect  some  systematic  dif- 
ference, and  that  use  of  the  original  set  of  forecasting  dis- 
tributions for  pairs  of  these  types  may  not  be  appropriate. 


What  Ar  distributions  are  associated  with  the  five 
historical  patterns  for  the  pairs  in  Sample  3? 


The  purpose  of  this  analysis  was  to  derive  a set  of  Ar  fore- 
casting distributions  for  cases  including  country  group  pairs 
and  issue  pairs  (Sample  3)  and  to  determine  how  these  distri- 
butions differed  from  the  original. 
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The  resulting  Ar  distributions  by  historical  pattern  were  simi 
lar  in  some  respects  and  different  in  others  from  those  derived 
from  Sample  1.  The  implication  is  that  it  may  be  preferable  to 
limit  the  use  of  R distributions  in  forecasting  to  pairs  equiva- 
lent to  those  from  which  the  distributions  were  originally 
derived . 


How  can  the  direction  of  Ar  acj  well  as  the 
magnitude  of  Ar  be  forecast"' 


Previous  experiments  focused  only  on  the  magnitude  of  Ar  be- 
cause of  sample  size  limitations.  Therefore,  the  forecasting 
distributions  derived  are  only  for  the  magnitude  of  change,  not 
its  direction. 

In  this  analysis,  the  most  current  value  of  R in  the  time  series 
(base  R)  was  assumed  to  be  related  to  the  subsequent  direction 
of  change  in  R,  primarily  because  the  R scale  is  constrained, 
i.e.,  ranges  only  from  +1.0  to  -1.0.  First,  the  distribution  of 
base  R was  compared  between  Samples  1 and  2 and  was  found  to  be 
almost  identical.  That  being  the  case,  the  larger  Sample  2 was 
employed  to  examine  the  relationship  of  base  R and  the  combined 
direction  and  magnitude  distributions  of  Ar. 

The  expected  relationships  were  found.  First,  the  more  extreme 
the  base  R value  the  greater  the  likelihood  of  change  away  from 
the  extreme.  Second,  the  greater  the  magnitude  of  Ar  the  more 
pronounced  was  this  effect.  Based  on  these  findings,  odds  on 
the  direction  of  change  as  a function  of  base  R and  Ar  were 
constructed  and  a means  proposed  for  producing  a probabilistic 
forecasting  distribution  reflecting  both  magnitude  and  direction 
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Forthcoming  validation  experiments  will  attempt  to  determine 
the  degree,  if  any,  to  which  forecasting  based  on  quantitively 
derived  analogies  is  superior  to  forecasting  by  chance  alone. 
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OBJECTIVES  AND  CURRENT  STATEMENT  OF  WORK 
- - - — 

The  objectives  of  this  research  are  the  development  and  eval- 
uation of  new  methods  of  event  data  analysis  and  new  techniques 
for  short  term  forecasting,  plus  the  assessment  of  the  utility 
of  such  new  techniques  as  they  might  be  applied  to  problems  of 
national  security  interest. 

The  new  methods  of  event  data  analysis  involve  the  treatment 
of  public  news  media  of  different  national  origins  as  reflect- 
ing the  official  perceptions,  interests  and  viewpoints  of  the 
originating  countries.  In  othar  words,  for  example,  we  treat 
The  Times  of  London  as  a surrogate  "spokesman"  for  the  UK,  as 
we  might  treat  Pravda  as  a surrogate  "spokesman"  for  the  USSR. 
The  implications  of  this  approach  for  the  DoD  and  intelligence 
communities  may  be  of  considerable  significance.  First,  the 
sources  themselves  are  freely  available.  Second,  the  similari- 
ties and  differences  they  reflect  may  shed  additional  light 
on  such  matters  of  national  security  interest  as: 

1.  How  countries  perceive  the  behavior  of  other  countries 
toward  themselves,  toward  other  countries  of  vital 

interest  to  them,  and  toward  evolving  and  continuing 

, 

crises , 

2.  How  two  countries  are  aligned  in  their  behavior  toward 
third  countries  and  regions,  and 

3.  Where  the  vital  interests  of  countries  tend  to  overlap 
and  where  they  are  separate,  and  so  on. 

n 

While  use  of  public  media  sources  as  surrogates  for  official 
opinion  and  policy  must  always  be  with  caution,  it  is  the 
purpose  of  this  research  to  assume  that  some  degree  of  sub- 
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stitutability  is  reasonable,  and  to  illustrate  the  kinds  of 
unique  information  such  an  approach  may  provide. 

The  new  techniques  for  short  term  forecasting  associate  the 
future  of  a current  situation  with  the  outcomes  of  similar 
past  situations  represented  quantitatively.  It  is  a form  of 
forecasting  by  analogy,  a technique  often  used  s ub jectively . 

In  quantitative  form,  howaver,  past  situations  constitute  a 
large  sample  and,  as  a result,  past  outcomes  may  be  represented 
probabilistically.  This  technique  seems  to  fill  a gap  in 
quantitative  forecasting  techniques  between  existing  extrapo- 
lative techniques,  which  have  generally  been  found  wanting  in 
terms  of  their  ability  to  predict  change,  and  the  availability 
of  theoretically  based,  empirically  tested  predictive  models  of 
international  behavior,  which  are  in  various  stages  of  deve- 
lopment. The  implications  of  this  approach  for  the  DoD  and 
intelligence  communities  lie  in  the  potential  ability  to,  in 
effect,  "classify"  a current  situation  according  to  the  past 
patterns  it  most  closely  resembles,  and  to  supplement  that 
classification  with  a set  of  probabilistic  estimates  of  the 
likely  degree  of  change  in  prospect. 

The  tasks  involved  in  the  project  Statement  of  Work  may  be 
summarized  as  follows: 

A.  Multiple  Data  Stream  Research 

Task  A- 1 . CACI  will  perform  comparative  analyses  based  on  both 
the  New  York  Times  and  The  Times  of  London  event  data  sources 
as  follows: 

a.  A literature  survey  will  be  performed  to  assess 
previous  research  in  the  area  of  inter-source 
comparisons  , 

b.  A comparative  source  analysis  will  be  performed  of 
interactions  between  the  USA  and  the  United  Kingdom, 

c.  Comparative  source  analyses  will  be  performed  of  inter 
action  between  other  pairs  of  international  actors,  an 


Comparative  source  analyses  will  be  performed  ot 
interaction  between  the  USA  and  the  United  Kingdom 
and  other  international  actors. 


d . 

Task  A- 0 . Based  on  the  results  of  Task  A-l,  the  principal  simi- 
larities and  differences  between  the  sources  in  both  scope  of 
coverage  and  point  of  view,  will  be  identified  and  evaluated. 

T*sk  A- 3 . The  potential  utility  of  multiple  data  stream  analysis 
as  a technique  for  providing  unique  information  to  DoD  from 
available  foreign  sources  will  be  assessed. 

B.  Short  Tern;  Forecasting  Research 

Task  B - 1 . CACI  will  undertake  further  development  of  univariate 
time  series  analysis  as  a technique  for  short  term  forecasting 
based  on  historical  analogies  as  follows: 

a.  CACI  will  expand  the  scope  of  development  by  experi- 
menting with  alternative  samples,  time  periods  and 
indicators . 

b.  CACI  will  attempt  to  validate  forecasting  patterns 
by  comparing  forecasts  with  observed  values  for  the 
1973-1974  period,  and  by  comparing  forecast  probability 
distributions  with  distributions  derived  randomly. 

c.  CACI  will  assess  the  utility  of  the  forecasting  „ech- 
que  based  on  the  preparation  and  interpretation  of 
sample  forecasts  for  one  or  more  regions. 

Task  B- 2 . CACI  will  examine  multivariate  cross-sectional  anal- 
ysis as  a technique  for  establishing  historical  precedents  for 
forecasting  short  term  crises  involving  the  use  of  military 
force.  Forecasts  based  on  the  technique  will  be  prepared  and 
the  utility  of  the  technique  will  be  assessed. 

C.  Dissemination  of  Results 

Task  C- 1 . Results  of  the  study  will  be  reported  in  an  interim 
technical  report  and  in  a final  technical  report. 
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TATUS  OF  MDS  RES  EAF'CH 


The  research  findings  reported  herein  are  based  on  selected 
comparative  analyses  of  international  affairs  information  re- 
ported in  two  public  media  sources,  the  daily  New  York  Times 
(NYT)  and  The  Times  of  London  ( _ OL ) . These  sources  are  similar 
in  that  both  are  leading,  globally  oriented  newspapers  pro- 
duced within  countries,  the  US  and  the  UK,  respectively,  which 
have  long  traditions  of  press  freedom.  As  such,  news  reported 
in  the  two  sources  may  be  assumed  to  overlap  only  partially 
with  official  governmental  views  of  international  affairs. 
Nevertheless,  in  the  analyses  it  will  be  assumed  that  these 
media  are  surrogates  for  officialdom  in  order  to  suggest  how 
such  analyses  might  be  interpreted  were  they  based  on  news 
sources  emanating  from  countries  which  exercise  control  over 
media  reporting,  i.e.,  countries  in  which  the  media  serve  the 
role  of  governmental  spokesman.  The  thrust  of  the  analyses 
will  be  to  determine  the  similarities  and  differences  between 
the  US  and  UK,  as  inferred  from  NYT  and  TOL,  respectively,  in 
their  geographic  interest  and  attention,  and  in  their  views  of 
international  relationships,  including  their  own. 


This  approach  to  the  use  of  and  comparison  of  multiple  sources 
of  event  data  differs  substantially  from  prior  analyses.  A 
survey  of  representative  research  reports  on  intersource  event 
data  comparison,  which  appears  heroin  as  Appendix  A,  shows  an 
emphasis  on  other  objectives.  gpc c i f ical ly , use  of  multiple 
data  sources  has  been  previously  viewed  primarily  as  a means  to: 

1.  increase  the  comprehensiveness  of  reporting  coverage  and 
enlarge  the  total  data  base  available  for  analysis, 

2.  reduce  bias  in  interpretation  by  .integrating  different 
points  of  view,  and 
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3.  provide  a means  to  validate  events  through  multiple 
observations . 

All  these  objectives  are  directed  primarily  toward  a determina- 
tion of  the  ’’true"  international  situation. 


On  the  other  hand,  the  objective  pursued  in  the  current  research 
is  toward  exploiting  rather  than  reducing  differences  which 
exist  among  sources.  The  intent  is  to  consider  each  source  as 
representing  unique  interests  and  points  of  view  relative  to 
international  affairs,  to  examine  source  similarities  and  dif- 
ferences, and  in  so  doing,  to  attempt  to  infer  the  commonalities 
and  oppositions  that  are  implied  between  the  countries  that  the 
sources  represent.  It  is  assumed  that  for  many  purposes  it  may 
be  more  important  to  be  aware  of  the  similarities  and  differences 
between  the  views  of  countries  than  to  be  aware  of  the  "true" 
state  of  foreign  affairs. 


All  of  the  international  event  data  employed  in  the  analyses 

•k 

were  previously  coded  from  NY T and  TOL  in  the  standard  WEIS 
format.  The  WEIS  coding  elements  include  the  actor  country 
and  the  target  country  for  each  event  (which  is  itself  coded 
into  one  of  63  potential  event  categories)  and  the  date  the 
event  was  reported  as  taking  place.  For  the  analysis  of  inter- 
action directly  between  the  US  and  the  UK  additional  coding 
was  performed  on  both  sources  to  identify  the  principal  sub- 
jects (or  issues)  of  interaction.  All  analyses  were  performed 
variously  using  the  raw  event  data,  aggregate  indicators  devel- 


WEIS  is  the  acronym  for  World  Event  Interaction  Survey,  a 
program  conducted  under  ARPA  sponsorship  at  the  University 
of  Southern  California  and  directed  by  Professor  Charles 
McClelland.  Event  coding  of  NYT  which  originated  at  USC  has 
been  conducted  by  CACI , Inc.  since  1972.  Event  coding  of 
TOL  continues  by  Prof.  McClelland  to  whom  we  are  indebted  for 
macing  the  TOL  data  available  for  our  use. 
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oped  from  the  event  data  , and  the  English  language  abstracts 
of  the  events  which  are  prepared  as  a matter  of  course  as  part 
of  the  event  coding  process. 


The  time  span  of  analysis  is  36  months,  from  July  1,  1971 
through  June  30,  1974.  While  for  seme  purposes  a longer  time 
span  might  have  been  preferable  this  particular  period  repre- 
sents the  maximimum  period  for  which  data  were  available  to 
the  project  from  both  sources.  For  this  36  month  period  the 
total  £ •• nt  data  yield  from  NYT  was  almost  exactly  double  that 
of  TOX  (30,925  events  vs.  15,279  events,  respectively). 

The  findings  of  the  MDS  analyses  are  organized  be)ow  in  terms 
of  a series  of  general  questions  posed  to  the  data.  Emphasis 
in  the  findings  is  on  the  similarities  and  differences  between 
JS  and  UK  views  presented  in  or  inferred  from  the  two  sources. 
The  assumption  throughout  is  that  countries  tend  to  act  in 
terms  of  their  own  views  rather  than  in  terms  of  any  other 
reality.  Therefore,  similarities  and  differences  in  current 
viewpoints  are  likely  to  precede  similarities  and  differences 
in  subsequent  courses  of  action. 


MDS  FINDINGS 


What  are  the  trends  in  the  overall  character  of  interna- 
tional affairs  between  mid-1971  and  mid-1974  as  conveyed 
by  NYT  and  TOL? 


Most  questions  posed  to  the  data  will  be  analysed  in  terms  of 
both  event  frequencies,  which  represent  magnitudes  of  reported 

★ 

For  a summary  description  of  event  data  and  the  aggregate 
indicators  employed  in  MDS  analysis  see  International  Affairs 
Indicators  for  Defense  Decision-Making,  Theodore  J.  Rubin, 
CACI;  Inc.  report  number  RM305,  January  1973.  Also,  for 
convenience  a brief  description  of  selected  indicators  appears 
as  Appendix  B to  this  report. 


interaction,  and  event  frequency  ratios  designed  to  represent 
the  friendliness  to  hostility  of  interaction. 


Table  1 displays  the  total  worldwide  event  frequency  reported 
in  each  of  the  two  sources  by  six  month  intervals  during  the 
available  three  year  time  span.  The  number  of  TOL  events  in 
each  period  is  relatively  constant  but  NYT  event  totals  show 
a continuous  increase  except  for  the  last  six  month  period. 
The  ratios  of  these  frequencies  in  Table  1 show  the  variation 
from  period  to  period  of  NYT  event  reporting  relative  to  that 
of  TOL . Key  international  episodes  of  importance  to  both 
countries  appear  to  the  right  of  the  table. 


Two  possible  and  related  explanations  of  the  increasing  trend 
in  NYT  worldwide  coverage  are  : 

1.  The  emphasis  placed  by  the  Nixon  administration  on 
foreign  affairs  and  peacemaking,  highlighted  by 
reconciliation  with  China,  and 

2.  The  managed  winding-down  of  US  military  activities  in 
S.E.  Asia,  coupled  with  close  scrutiny  by  the  press 
of  U.S.  involvement  there. 

Since  neither  of  these  factors  would  necessarily  be  expected 
to  be  as  heavily  reported  in  the  UK,  TOL  event  coverage  might 
well  be  expected  to  be  less  changeable  than  NYT  over  the  period 
under  examination. 


Table  2 tends  to  lend  substance  to  these  explanations.  Here, 


worldwide  values  for  the  Relations  indicator  are  displayed  for 
the  same  time  intervals  as  in  Table  1.  Note  that  there  is  an 


improving  trend  in  worldwide  Relations  as  derived  from  NYT  re- 
ports, beginning  in  1972.  (The  Relations  index  is  increasingly 
less  negative.)  On  the  other  hand,  worldwide  Relations,  as 
derived  from  TOL  is  virtually  constant,  except  for  the  second 
half  of  1973  when  the  Yom  Kippur  War  took  place  and  the  Arab 
Oil  Embargo  began.  The  latter  episode  had  much  more  immediate 


See  Appendix  B. 
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Total  Events  Reported, 
Worldwide 


Time 

Inte  rval 


1 

NYT 

TOL 

Key  International  Episodes 


1971,  2nd  half 

1972,  1st  half 

1972,  2nd  half 

1973,  1st  half 

1973,  2nd  half 

1974,  1st  half 

Total,  36  months 


TABLE  2. 

Worldwide  Relations,  mid-1971  to  mid-1974 


Time 

Interval 


Worldw 


wide  Relations 


NYT 

NYT 

TOL 

minus 

TOL 

1971, 

2nd 

half 

1972, 

1st 

half 

1972, 

2nd 

half 

1973, 

1st 

half 

1973, 

2nd 

half 

1974, 

1st 

half 

Key  International  Episodes 


UK  joins  Common  Market 
India-Pakistan  War 


Nixon  visits  Peking  s Moscow 


Truce  in  S.E.  Asia 
E.German-W. German  Treaty 

Yom  Kippur  War 
Arab  Oil  Embargo 


Total,  36  months 


-.29  -.02 


BHI 


and  traumatic  effects  on  UK  and  its  foreign  relations  than  on 
the  US. 

The  difference  between  worldwide  Relations  values  also  appears 
in  the  table.  This  index  shows  the  relatively  greater  negative 
perspective  of  TOL  during  and  subsequent  to  events  during  the 
last  half  of  1973. 


The  overall  implications  of  these  two  displays  are  that  from 

the  US  point  of  view  (NYT ) : 

• The  period  under  examination  was  one  where  expanded 
attention  to  and  activity  in  "peacemaking"  in  foreign 
affairs  resulted  in  a continuing  reduction  in  worldwice 
hostility --notwithstanding  the  occurrence  of  war  in 
the  Middle  East. 

From  the  UK  point  of  view  (TOL) : 

• Nothing  sufficiently  atypical  characterized  this 
period  or  resulted  in  more  than  marginal  variation  in 
attention  to  foreign  affairs  or  in  the  quality  of 
foreign  affairs,  except  the  impact  of  the  Yom  Kippur 
War  and  the  associated  oil  embargo. 


The  question  of  national  interest  or  attention  can  best  be 
addressed  in  terms  of  the  geographic  distribution  of  a country's 
worldwide  actions  relative  to  its  own  location.  Both  the  US 
and  UK  are  acknowledged  world  powers,  or  at  least  in  the  case 
of  UK,  internationalistic  in  interest.  Table  3 displays  the 
distributions  of  actions  of  both  countries,  as  reported  by 
their  own  media,  toward  the  world  divided  into  four  major  geo- 
graphic aggregates  plus  organizations  (such  as  NATO,  UNO,  etc.). 
The  table  clearly  shows  the  major  differences  in  attention  of 
the  two  countries.  During  the  period  of  interest,  the  UK  directed 
about  two-thirds  of  its  actions  toward  Europe  and  Africa  while  the 
US  directed  about  two-thirds  of  its  actions  toward  Asia  and  var- 
ious international  organizations.  These  differences  are  appar- 
ently dominated  by  geographic  factors,  including  the  location  of 
UNO  in  New  York. 

Table  4 provides  a more  detailed  view  of  the  same  information. 

At  this  greater  level  of  target  detail,  i.t  is  seen  that  pre- 
dominance is  not  geographically  based  alone  but  is  also  a func- 
tion of  strategic  and  historical  factors.  For  example,  in 
Europe  which  is  the  predominant  interest  of  UK,  the  US  never- 
theless directs  more  than  twice  as  much  of  its  total  attention 
to  the  USSR  than  does  UK.  On  the  other  hand,  in  Asia  which  is 
the  predominant  interest  of  the  US,  the  UK  directs  about  twice 
as  much  attention  to  its  former  colonies  than  does  the  US. 

Only  with  respect  to  China  and  the  Middle  East  is  the  relative 
attention  of  the  US  and  UK  about  the  same. 

The  US  and  UK  might  be  considered  more  closely  akin  in  view- 
point than  most  countries  because  of  their  common  heritage 
and  culture  and  similar  economic  and  political  philosophies. 


TABLE  3. 

Aggregate  Distribution  of  US  and  UK  Actions 
mid-1971  to  mid-1974 


TARGET 

Percent  of 

total  actions 

US,  in  NYT 

UK,  in  TOL 

Western  Hemisphere,  incl.  US 

4 . 6 

6.5 

Europe,  incl.  UK 

18.  3 

* 

48.5 

Africa 

9 . 5 

* 

18.6 

Asia 

40.1* 

13.1 

Organizations 

★ 

27.4 

13.1 

TOTAL 

99.9 

99 . 8 

•k 

predominant  in  attention 


- 


TABLE  4 

Distribution  of  US  and  UK  Actions  to  15  Target  Groups 

mid- 1971  to  mid-1974 


Percent  of  total  actions 

TARGET 

US,  in  NYT 

UK,  in  TOL 

Western  Hemisphere 

US 

— 

4 . 4 

North  £ Central  America 

2.7* 

1 . 2 

South  America 

1.9* 

. 9 

Europe 

UK 

. 9 

— 

USSR 

8.5* 

3 . 6 

Other  Europe 

8 . 9 

44.9* 

Africa 

Middle  East 

7.6 

7 . 2 

North  Africa 

. 9 

1 . 7* 

All  other  Africa 

1 . 0 

9.7* 

Asia 

China 

2 . 0 

2 . 1 

Japan 

2.4* 

. 9 

India,  Pakistan 

2 . 2 

4.1* 

S.E.  Asia 

30.6* 

. 9 

All  other  Asia 

2 . 9 

5.1* 

Organizations 


TOTAL 


99 . 8 


predominant  in  attention 


<* 


But  in  foreign  affairs  their  interests  appear  to  be  dominated 
by  geography  plus  historical  and  strategic  factors.  The  impli- 
cations of  these  two  displays  are  that  from  the  US  point  of 
view : 

• S.E.  Asia,  the  USSR  and  the  Middle  East  were  paramount 
foci  of  its  interest  during  the  period  in  question, 
alonq  with  participation  in  international  organizations. 

Prom  the  UK  point  of  view: 


Europe  transcends  all  other  interests  in  importance, 
with  moderate  attention  paid  to  the  Middle  East  and 
ex-Colonial  Africa  as  well. 


These  distributions  define  very  different  sets  of  prioritized 
interests  as  between  the  US  and  UK. 


What  are  the  comparative  interests  of  US  and  UK  in  other 
actor  countries  as  conveyed  by  NYT  and  TOL? 


Another  aspect  of  the  attention  and  interest  of  two  countries, 
besides  the  distributions  of  their  own  actions,  is  their 
attention  to  the  actions  of  other  countries.  Table  5 presents 
information  which  permits  comparison  between  the  US  and  UK  in 
this  aspect  of  international  attention  during  the  36  months 
under  examination. 


Table  5 was  constructed  by  listing  the  25  highest  ranking 
* 

countries  in  NYT  relative  to  number  of  actions  they  reportedly 
initiated.  The  percent  of  total  NYT  reported  actions  attributed 
to  each  actor  is  also  shown.  In  the  last  two  columns  of  Table  5 
the  corresponding  ranks  and  percentages  for  each  country  in  TOL 
are  shown  where  the  country  is  also  among  the  leading  25  actors 
in  TOL . Those  countries  in  TOL 1 s leading  25  which  are  not 
common  to  the  NYT  list  are  appended  at  the  bottom  of  the  table. 


Abbreviations  for  country  names  are  employed  in  this  and  sub- 
sequent tables.  For  a list  of  all  countries  and  corresponding 
abbreviations  see  Appendix  C. 
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TABLE  5 


Leadinc  Actor  Countries  as  Viewed  by  US  and  UK 


Actor  Country 


TOTAL 


mid-1971  to  mid-1974 


% of  total 
actions  reported 


19 . 8 
9 . 1 


75.6 


% of  total 
actions  reported 


10 . 1 
5 . 4 

4 . 6 

5 . 6 
5 . 5 

3 . 8 
3 . 1 

7.6 
1 . 1 
3 . 0 
1 . 2 

2 . 9 


68.3 


1 


15 


- 'a, 


it 


t 


I 
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The  table  shows  great  similarity  between  NYT  and  TC  as  follows: 

1.  Nineteen  of  the  25  leading  NYT  actors  are  also  among 
the  leading  25  TOL  actors. 


2 . 


The  leading  25  actors  in  each  source  (16%  of  all  ac- 
tors) are  responsible  for  75%  of  all  actions  reported 
by  NYT  and  68%  by  TOL . 


3 . 


The  19  actors  common  to  both  lists  consist  exclusively 
of  countries  which  are  the  world's  leading  powers 
and/or  were  involved  in  active  conflict  during  the 
period  of  interest. 


Therefore,  most  of  the  actions  reported  by  both  sources  are  con- 
centrated in  a relatively  small  fraction  of  all  potential  actors, 
and  these  actors  are  essentially  the  same  for  both  sources. 


Additional  relevant  points  are 


1 . 
2 . 


The  leading  actor  in  both  sources  is  the  US. 

TOL  reports  of  UK  actions  rank  second  in  that  source 
to  the  US. 

Of  the  six  NYT  actors  not  among  the  25  leading  TOL 
actors : 

• 2 are  Western  Hemispheric  countries  (Canada  and  Chile) , 

• 2 are  Asian  (Laos  and  South  Korea) , and 

• 2 are  Middle  Eastern  (Saudi  Arabia  and  Lebanon). 

Of  the  six  TOL  actors  not  among  the  leading  25  NYT 
actors : 

• 2 are  African  (Uganda  and  Zambia) , 

• 3 are  European  (Iceland,  Malta  and  Italy),  and 

• 1 is  Middle  Eastern  (Iraq;. 


The  geographic  locations  of  these  non-common  actors  correspond 
generally  to  the  differences  in  geographic  focus  noted  earlier 
relative  to  US  and  UK  initiated  actions. 


The  implication  of  this  display  is  that  while  the  US  and  UK 
differ  in  their  interests  and  in  the  allocation  of  their  own 
attention  on  geographic,  historical,  and  strategic  grounds  — 
they  are  similarly  attentive  with  respect  to  other  actors,  par- 
ticularly the  powerful  and  the  conflictful. 
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What  are  the  comparative  interests  of  the  US  and  UK 
in  the  interaction  between  pairs  of  countries  as  con- 
veyed by  NYT  and  TOL? 


A third  aspect  of  the  international  interests  of  two  countries 
is  the  country  pairs  whose  interactions  draw  their  attention. 
Table  6 identifies  the  25  country  pairs  in  NYT  and  TOL  which 
were  highest  ranking  during  the  time  period  under  examination 
in  terms  of  interaction  (i.e.,  total  actions  reported  between 
each  pair).  The  table  was  constructed  in  a manner  identical 
to  Table  5 . 


Table  6,  like  Table  5,  shows  similarity  in  the  attention  of 
NYT  and  TOL  as  follows: 

1.  Eighteen  of  the  25  leading  NYT  pairs  are  also  common 
to  TOL . 

2.  The  leading  25  pairs  in  each  source  (about  1%  of  all 
possible  pairs)  account  for  about  35%  of  all  actions 
reported  in  both  sources. 

3.  The  18  pairs  common  to  both  lists  consist  exclusively 
of  pairs  of  major  powers,  pairs  experiencing  conflict, 
and  major  power  interaction  with  individual  members 

of  conflict  pairs. 

Therefore,  as  was  the  case  for  leading  actors 
in  both  sources  is  concentrated  on  relatively 
to  both  sources. 


Additional  relevant  points  are: 

1.  Eight  of  the  18  leading  pairs  common  to  both  sources 
include  the  US  as  a pair  member. 

2.  Of  the  seven  NYT  pairs  not  among  the  leading  25  in  TOL: 

• 5 include  the  US  as  a pair  member, 

• 1 is  an  Asian  pair  (KON-KOS),  and 

• 1 is  a UK  pair  (UK.-IRE)  . 

3.  Of  the  seven  TOL  pairs  not  among  the  leading  25  in  NYT : 

• 5 include  UK  as  a pair  member, 

• 1 is  a Middle  East  pair  (UAR-LBY) , and 

• 1 is  a European  pair  (FRN-GMW). 


(Table  5),  interest 
few  pairs,  common 


These  findings  suggest  that  both  sources  are  particularly  sen- 
sitive to  international  activity  involving  the  US.  They  also 
suggest  that  where  differences  in  attention  exist  these  dif- 
ferences are  largely  parochial,  i.e.,  NYT  concentrates  atten- 
tion on  additional  US  pairs,  and  TOL  concentrates  attention 
on  UK  pairs . 

The  implications  here  are  similar  to  those  of  Table  5.  While 
the  US  and  UK  differ  in  the  distribution  of  their  own  actions, 
they  are  similarly  attentive  to  the  interactions  of  conflict- 
ful pairs,  major  power  pairs,  and  major  power  involvement  with 
conflict  pair  members.  Beyond  these  common  foci  US  and  UK  tend 
to  concentrate  on  their  own  interactions  with  other  countries. 


How  do  the  US  and  UK  view  the  quality  of  their  own  and 
each  other's  actions  toward  other  countries  as  conveyed 
by  NYT  and  TOL? 


All  prior  research  questions  dealt  with  selected  frequencies 
and  distributions  of  NYT  and  TOL  reported  events  as  a means 
to  compare  US  and  UK  attention  to  and  interest  in  foreign  affairs. 
The  above  question  and  subsequent  ones  deal  with  the  friendly 
to  hostile  quality  of  reported  events  as  a means  to  compare  US 
and  UK  views  regarding  each  other,  other  country  pairs  and 
other  individual  countries. 

Since  US  and  UK  are  regarded  as  having  a "special  relationship", 
based  on,  among  other  things,  a "commonality  of  interests",  it 
might  be  expected  that  in  most  instances  the  views  of  the  two 
countries  of  their  actions  toward  other  countries  and  of  the 
actions  of  other  countries  toward  themselves  would  be  similar. 
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Tables  7,8,9,  and  10  provide  information  bearing  on  this  ex- 

* 

pectation.  Tables  7 and  8 display  the  Policy  Styles  of  the 
US  and  UK,  respectively,  toward  selected  targets  as  derived 
from  actions  reported  in  both  N YT  and  TOL . Tables  9 and  10 
display  the  Policy  Styles  of  selected  actors  toward  the  US  and 
UK,  respectively,  as  derived  from  the  two  sources.  The  various 
targets  in  Tables  7 and  8,  and  actors  in  Tables  9 and  10  are 
those  which  were  reported  in  TOL  as  directing  to  or  receiving 
from  US  and  UK  a total  of  15  or  more  events  over  the  36  month' 
time  period  of  interest. 

In  each  table  the  actors  or  targets  are  listed  in  the  order  of 
most  positive  to  most  negative  Policy  Style  as  derived  from  NYT . 
The  corresponding  Policy  Style  value  derived  from  TOL  is  shown. 
Finally,  the  difference  in  Policy  Styles  (NYT  minus  TOL)  appears. 
The  latter  index  illustrates  the  disparity  between  the  views 
conveyed  by  the  two  sources.  Positive  differences  in  this 
index  indicate  a more  positive  view  in  TOL  than  in  NYT ; nega- 
tive differences  indicate  a more  negative  view  in  TOL  than  in 
NYT . Positive  or  negative  differences  less  than  .2  suggest  no 
significant  difference  in  view,  or  correspondence. 

Table  7 displays  the  Policy  Style  values  of  the  US  toward  19 
targets.  If  NYT  were  truly  indicative  of  US  policy  (i.e.,  if 
it  were  in  effect  a spokesman  for  US  governmental  policy)  then 
the  values  listed  under  NYT  would  be  interpretable  as  official 
"signals"  to  the  targets.  In  this  case,  TOL  plays  the  role  of 
observer.  Its  Style  values  would  reflect  its  observations  of 
US  signals  toward  the  targets.  In  Table  7,  then,  it  might  rea- 
sonably be  assumed  that  NYT  based  Style  values  are  more  authori- 
tative than  TOL  based  Styles,  and,  therefore,  that  the  difference 
in  Style  reflect  misinterpretation  by  TOL  (or  UK)  of  US  intent. 
Tables  8,9  and  10  are  subject  to  similar  interpretation. 


TABLE  7. 

Policy  Style  of  US  to  Selected  Targets, 
mid-1971  to  mid-1974 


Policy  Style 

TARGET 

NYT 

TOL 

NYT-TOL 

CAM 

. 65 

. 57 

- . 08 

JOR 

. 50 

. 59 

. 09 

NATO 

. 46 

. 04 

- . 42 

ISR 

. 34 

. 18 

- . 16 

CPR 

. 29 

. 33 

. 04 

GMW 

. 28 

.05 

-.23 

UAR 

. 27 

. 34 

.07 

VTS 

.26 

. 31 

.05 

US  R 

. 24 

.05 

- . 19 

JAP 

. 21 

. 36 

. 15 

UNK 

.13 

.08 

- . 05 

MLG 

. 12 

.09 

-.03 

SYR 

0 

- . 06 

- . 06 

FRN 

- . 07 

. 37 

. 44 

EEC 

- . 08 

-.17 

- . 09 

UNO 

- . 15 

- . 16 

- . 01 

IND 

-.17 

-.  36 

- . 19 

VTN 

- . 71 

- . 73 

- . 02 

VCG 

-.77 

- . 70 

. 07 

test  A 


TARGET 


NYT 


TOL 


NYT-TOL 


GMW 

. 57 

. 17 

- . 40 

FRN 

. 44 

.04 

- . 40 

CPR 

. 27 

. 31 

. 04 

USA 

. 15 

0 

- . 15 

MLG 

. 08 

.20 

. 12 

EEC 

0 

. 04 

. 04 

RHO 

0 

^0 

CN 

1 

- . 26 

UAR 

0 

.50 

. 50 

PAK 

0 

. 55 

. 55 

IRE 

- . 09 

-.55 

- .46 

US  R 

- . 15 

- .24 

- . 09 

ISR 

- . 18 

0 

! 

. 18 

MLT 

-.23 

-.31 

- . 08 

UNO 

- . 26 

-.33 

ICE 

- . 67 

- . 56 

. 11 

UGA 

- . 90 

-.78 

.12 

LB  Y 

- .90 

-.62 

. 2 8 

Policy  Style 


ACTOR 

NYT 

TOL 

NYT- TOL 

GMW 

. 31 

.12 

- . 19 

ISR 

. 2 2 

.12 

- . 10 

JAP 

. 2 2 

.69 

.47 

UNK 

. 15 

0 

- . 15 

EEC 

. 05 

0 

- . 05 

US  R 

- .01 

-.23 

- . 16 

SAU 

- . 09 

.08 

.17 

MLG 

- . 09 

-.22 

-.13 

SYR 

- . 19 

- .11 

CO 

o 

UAR 

- . 26 

-.45 

- . 19 

VTS 

- . 32 

-.  30 

. 02 

FRN 

- . 39 

-.  31 

.08 

CP  R 

- . 42 

-.48 

- . 06 

IND 

- . 51 

-.84 

-.33 

VCG 

- . 73 

-.  54 

. 19 

VTN 

- . 77 

-.  56 

. 21 

fcr- 
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Table  11  summarizes  an  analysis  of  the  Policy  Style  value  dif- 


ferences in  Tables  7,8,  9 and  10.  The  table  shows  the  total 


number  of  cases  in  each  analysis,  those  where  views  between 
US  and  UK  correspond  and  those  where  misinterpretation  is  evi- 


dent, either  by  US  or  UK. 


The  percentage  distribution  at  the  bottom  of  the  table  reveals 


that  similar  views  are  held  in  over  three  fourths  (77%)  of  the 


total  cases.  Further,  it  reveals  that  where  misinterpretation 


is  present,  either  in  NYT  or  TOL , it  tends  to  be  large, 


It  is  these  latter  cases,  where  apparent  misinterpretation  is 
large,  that  are  of  particular  interest  as  a finding  of  multiple 
data  stream  analysis.  In  such  instances,  the  assumption  is 
that  different  views  are  held  by  US  and  UK  Of  the  same  phenom- 


enon and  that  these  views  will  be  the  realities  which  prompt 


or  alter  future  actions.  In  MDS , explanations  of  such  cases 
may  and  should  be  sought  through  both  further  disaggregation 
of  the  data  and  by  review  and  analysis  of  the  English  language 
event  descriptions.  An  example  of  such  more  exhaustive  analy- 
sis appears  in  the  evaluation  of  the  ’S-UK  pair  in  the  follow- 


ing section 


The  implications  of  the  foregoing,  however,  are  that  the  US 
and  UK  do  show,  for  the  most  part,  similar  views  of  the  quality 
of  actions  each  is  initiating  and  receiving  in  its  international 
affairs.  There  are  exceptions,  however,  and  where  they  exist 
they  suggest  misinterpretation  of  the  signals  being  transmitted 
or  received  by  the  other. 
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What  are  the  US  and  UK  views  of  their  own  interaction 
as  conveyed  by  NYT  and  TOL ? 


The  analyses  reported  here  are  concerned  with  the  Policy  Styles 
of  the  US  and  UK  toward  each  other  as  conveyed  by  NYT  and  TOL. 

The  initial  question  investigated  was  whether  the  two  sources 
perceive  each  directed  dyad  (UK-^US;  US— >UK)  similarly  or  not. 

Four  Style  timeseries  plots  were  constructed,  each  showing  the 
NYT  and  TOL  Policy  Styles  of  one  actor  toward  the  other  during 
nine  quarterly  periods.  The  graphs,  shown  in  Table  12,  reveal 
that  one  source  sometimes  leads  the  other  in  its  perception  of 
a nation's  Policy  Style. 

j 

The  specific  leads  in  the  data  are  these: 

1.  The  NYT  Policy  Style  for  UK— >U S leads  the  TOL  Policy 
Style  for  the  same  dyad  during  the  first  five  time 
periods ; 

2.  The  TOL  Policy  Style  for  US— >UK  leads  the  NYT  Policy 
Style  for  the  same  dyad  during  the  last  five  periods. 

The  visual  impression  of  leads  was  confirmed  by  comparing  the 
styles  conveyed  by  the  two  sources  in  the  same  time  period  and 
at  leads  of  one  period.  Table  13  reveals  that: 

1.  The  absolute  differences  in  NYT  and  TOL  reporting  of 

US— ^UK  style  are  less  when  TOL  leads  NYT  by  one  period 
than  are  the  differences  in  the  same  period.  Thus, 
for  this  dyad  the  the  TOL  at  time  t-1  is  a better  pre- 
dictor than  TOL  at  time  t. 


2.  The  absolute  differences  in  NYT  and  TOL  reporting  of 

UK— >US  style  are  less  when  NYT  leads  TOL  by  one  period 
than  the  differences  in  the  same  period.  Thus,  for 
this  dyad  the  NYT  at  time  t-1  is  a better  predictor 
than  NYT  at  time  t. 


This  confirms  the  visual  impression  of  the  leads.  The  impres- 
sion that  in  the  US->UK  dyad  TOL 1 s lead  is  more  prominent  during 
the  last  five  periods  is  confirmed  in  a similar  fashion,  as  is 
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TABLE  13. 


Source  Differences  in  UK-US  Style 


Mean  Absolute  Difference 


TOL  -NYTfc 


TOL  , -NYT ' 
1-1  1 


Mean  Absolute  Difference 


NYT. -TOL. 


NYT  , -TOL  j 
1-1  1 


TABLE  14 


Effects  of  Lagging 


Improvement  or  Worsening  in  TOL1 s Prediction  of  NYT  by 
Lagging  TOL  One  Period. 


Last  Five  Periods  Remaining  Periods 


US-XJK  Improvement  Worsening 

(average  |tOL-NYt|  (average [tOL-NYt| 

difference  decreases  difference  increases 
.10  by  lagging  TOL)  .01  by  lagging  TOL) 


Improvement  or  Worsening  in  NYT' s Prediction  of  TOL  by 
Lagging  NYT  One  Period. 


First  Five  Periods  Remaining  Periods 


UK->US 


Improvement 


Worsening 


(average  |TOL-NYTj  (average  [T0L-NYt| 

difference  decreases  difference  increases 


.18  by  lagging  NYT)  .04  by  lagging  NYT) 


---»*• 
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the  impression  that  in  the  UK— >US  dyad  NYT 1 s lead  is  more  promi- 
nent during  the  first  five  periods.  Table  14  shows  that  in  the 
US— >UK  dyad,  predictions  of  NYTfc  by  TOLt  during  the  last  five 
periods  are  better  than  predictions  by  TOL  , while  in  the  re- 
maining periods  the  TOL  lag  is  not  effective  in  improving  pre- 


dictions of  NYT  . Table  14  also  shows  that  in  the  UK-*US  dyad, 


predictions  of  TOL ^ by  N YT  during  the  first  five  periods  are 


better  than  predictions  by  NYT  , while  in  the  remaining  periods 


the  NYT  lag  is  not  effective  in  improving  predictions  of  TOL^ . 


The  above  observations  can  be  summarized  thusly:  In  some  periods, 

the  target's  perceptions  of  an  actor's  Policy  Style  leads  the 
actors'  perceptions.  Visual  inspection  of  Tables  12  and  13  will 
readily  convince  one  that,  with  the  exception  of  the  lead  phe- 
nomenon, the  view  of  UK-US  interaction  conveyed  by  the  two 
sources  is  quite  similar  over  time. 


The  implications  of  the  UK-US  dyad  analysis  thus  far  are  that: 


The  two  nations  did  not  perceive  their  interactions 
very  differently,  but  that 


At  times  one  nation's  perceptions  of  the  other's  Style 
anticipated  the  other's  view,  suggesting  that 


MDS  analysis  may  be  helpful  in  predicting  some  nation's 
perceptions  of  others'  policies.  But  a caution  is  in 
order  to  the  effect  that 


One  nation's  ability  or  tendency  to  anticipate  another's 
perceptions  appears  to  be  transitory. 


These  observations  are  intriguing  because  they  initially  seem 
counter-intuitive,  and  because  they  constitute  phenomena  of 
potential  interest  to  government  personnel.  They  are  contrary 
to  the  intuitive  expectation  that  a target's  perception  of  an 
actor's  style  would  follow,  not  lead,  the  actor's  perception. 
They  are  potentially  interesting  to  government  personnel  who 
would  find  useful  an  ability  to  forecast  Style  perceptions  by 
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means  of  MD3  analysis.  The  analysis  therefore  turned  to  a 
closer  examination  of  the  content  ind  explanation  of  the  ob- 
served leads . 


In  what  subjects  are  leads  contained? 


Having  observed  that  the  lead  phenomenon  is  transitory  present 
at  some  times  but  not  at  others — we  considered  possible  reasons 
for  its  impermanence.  We  have  previously  observed  that  the 
prominence  of  different  subjects  in  the  affairs  of  two  states 
varies  over  time.  We  reasoned  that  this  variation  could  con- 
tribute to  the  lead's  impermanence.  If  certain  subjects  are 
more  than  others  responsible  for  the  leads,  then  the  coming  and 
going  of  subject  emphases  in  UK-US  interaction  could  contribute 
to  the  transitory  nature  of  the  leads.  We  therefore  examined 
the  data  to  determine  whe  ther  some  s ub  j e c t s more  than  others 
are  responsible  for  the  observed  leads.  Each  event  was  coded 
for  the  subject  with  which  it  was  associated.  They  were  coded 
on  the  basis  of  short  descriptive  abstracts  of  the  events.  The 
abstracts  are  routinely  generated  along  with  the  numeric  event 
codes  referred  to  earlier.  The  subjects  upon  which  the  analyses 
ultimately  focused  were  those  for  which  adequate  data  were  pre- 
sent: Defense,  Economic  Affairs,  Energy  and  the  Middle  East, 

and  General  Relations. 

The  result  of  these  analyses  showed  that  certain  subjects  are 
more  responsible  than  others  for  the  observed  leads.  Specifi- 
cally, the  Defense  subject  is  most  responsible  for  the  NYT  lead 
in  the  UK-^US  dyad  while  the  Economic  Affairs  subject  is  most 
responsible  for  the  TOL  lead  in  the  US->UK  dyad.  The  method 
used  to  determine  the  responsibility  of  a subject  for  a lead 
was  to  extract  from  the  data  events  dealing  with  the  subject, 
then  to  recompute  the  Styles,  and  then  to  recompute  the  average 


absolute  difference  between  the  leading  source  at  t-1  and  the 
other  source  at  t.  If  this  difference  was  greater  than  the 
difference  when  the  subject  was  still  in  the  data,  then  we 
concluded  that  the  subject  had  made  a contribution  to  the  lead. 
The  degree  of  its  contribution  depends  on  how  much  the  source 
differences  increase  when  the  subject  is  removed  from  the  data. 
There  is  also  the  possibility  of  a "negative  contribution"  to 
the  lag,  as  when  after  removing  a subject  the  lag  is  even  more 
prominent.  Table  15  shows  the  effect  of  removing  the  four 
subjects  from  each  dyad.  Larger  positive  values  in  Table  15 
indicate  greater  responsibility  for  leads. 
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Implications  of  these  findings  are  that: 

• While  one  nation's  view  of  the  other's  Policy  Style  may 
lead--and  therefore  be  a predictor  of--the  other's  view 
on  some  subjects,  the  tendency  to  lead  does  not  neces- 
sarily apply  to  all  subjects.  This  suggests  that 

• The  policy  use  of  any  observed  lead  should  be  sensitive 
to  the  possibility  that  the  lead  is  due  to  specific  sub- 
jects, and  that  the  lead  may  quickly  disappear  if  inter 
action  on  the  responsible  subjects  is  discontinued. 


Having  found  that  leads  in  Policy  Style  are  due  in  varying 
degrees  to  different  subjects,  we  next  turned  to  the  task  of 
exploring  explanations  of  the  leads.  Since  different  subjects 
are  responsible  in  varying  degrees  for  leads,  we  used  subjects 
as  cases  and  attempted  to  relate  subject  leads  to  other  ex- 
planatory variables. 


Are  Policy  Style  leads  related  to  emphasis  leads? 


An  explanation  for  why  a given  subject  may  contribute  to  one 
source's  lead  in  the  perception  of  a nation's  Style  is  that  the 
source  may  lead  the  other  in  its  emphasis  (concern  or  weighting) 
of  the  subject.  Overall  Style  is  a weighted  sum  of  subject- 


specific  Styles,  where  weighting  is  on  the  basis  of  each  sub- 
ject's share  of  the  total  number  of  events.  Thus,  to  the 
extent  that  source  A's  weighting  of  a subject  follows  source 
B's  weighting--and  if  relatively  similar  subject-specific 
Styles  are  being  reported  by  both  sources--the  subject  will 
make  a contribution  to  source  B's  overall  Style  lead  over 
source  A. 


We  examined  our  data  to  determine  whether  the  s ub j ec t -spec i f ic 
Styles  reported  by  the  two  sources  are  relatively  similar  or 
not.  Eight  cases  were  used  in  the  analysis:  each  of  the  four 

subjects  for  each  of  the  two  directed  dyads.  The  Styles  con- 
veyed by  the  two  sources  for  the  entire  period  covered  were 
calculated  and  correlated  across  the  eight  cases.  The  product- 
moment  correlation  of  +.85  confirms  that  the  sub ject— specif ic 
styles  of  the  two  sources  are  related  in  a positive  way.  The 
scatter-plot  of  these  eight  cases  is  shown  in  Table  16.  The 
assumption  of  relatively  similar  subject-specific  Styles  being 
met,  it  remained  to  examine  whether  the  contribution  of  a sub- 
ject to  a source's  Style  lead  is  related  to  the  source's  lead 
in  subject  emphasis. 


In  the  analyses  designed  to  examine  this  question  we  used  those 
subjects  on  which  both  sources  had  some  reports  in  more  than 
three  of  the  nine  time  periods  in  the  data.  We  restricted  the 
analyses  to  these  subjects  because  even  a subject  on  which  an 
emphasis  lead  is  present  could  not  be  expected  to  contribute 
significantly  to  the  overall  Style  lead  if  that  subject  were 
active  for  a third  or  less  of  the  time  period  covered  in  the 
study.  This  restriction  leaves  five  cases  for  the  analysis, 
not  enough  to  support  conclusive  results  but  adequate  for  an 
initial  examination  of  the  explanation.  The  development  in 
emphases  by  the  two  sources  in  these  five  subjects  are  shown 
in  Tables  17  through  21.  Tables  17,  18  and  19  show  subject 

emphases  in  the  UK— ^US  dyad;  Tables  20  and  21  show  emphases  in 
the  US-»UK  dyad. 
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An  emphasis  lead  is  apparent  to  the  extent  that  one  source's 
emphasis  lags  behind,  then  "catches  up"  to  the  other's  emphasis. 
In  the  UK— ^US  dyad,  such  a "catch  up"  occurs  most  prominently 
in  the  Defense  subject  (Table  17)  where  the  TOL  emphasis  lags 
behind  but  then  catches  up  to  the  NYT  emphasis.  In  the  US— >UK 
dyad,  it  is  most  prominent  in  the  Economics  subject  (Table  20) 
where  the  TOL  emphasis  clearly  portends  the  future  of  the  NYT 
emphasis.  Thus  we  find  the  stronger  emphasis  leads  to  be  the 
NYT  in  the  Defense  subject  in  the  UK— ^US  dyad,  and  the  TOL  in 


the  Economics  subject  in  the  US— VUK  dyad.  How  do  these  emphasis 
leads  relate  to  the  Style  leads  discussed  earlier?  Referring 
back  to  Table  16  we  find  that  in  the  UK— >US  dyad,  the  Defense 
subject  makes  the  greatest  contribution  toward  the  NYT  style 
lead,  while  in  the  US-*UK  dyad  the  Economics  subject  makes  the 
greatest  contribution  toward  the  TOL  style  lead.  The  relation- 
ship between  style  and  emphasis  leads  is  then,  very  clear:  the 

subject  most  responsible  for  a source's  Style  lead  is  the  sub- 
ject on  which  the  source's  emphasis  is  in  the  lead. 


The  main  implication  of  these  findings  seems  to  be  that: 


a nation  tends  to  correctly  anticipate  another's  view 
of  the  quality  of  their  affairs  when  it  correctly  an- 
ticipates the  relative  attention  that  will  be  given  to 
different  subjects. 


This  implication  is  quite  plausible,  since  different  subjects 
are  characterized  by  different  qualities  of  behavior.  For  ex- 
ample, one  could  go  far  in  predicting  the  future  quality  of 
US-Soviet  relations  if  the  subjects  on  which  attention  will  be 
focused  could  be  predicted,  for  the  quality  of  each  nation's 
behavior  varies  across  subjects  such  a s e migration , the  Middle 
East,  China,  economic  relations,  and  so  forth.  The  foregoing 
demonstrates  a potential  application  of  MDS  analysis  in  the 
identification  of  subject  emphasis  leads  and  therefore  in  the 
forecasting  of  nation's  views  of  the  quality  of  their  behavior, 
as  these  are  conveyed  by  news  sources. 
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The  discovery  that  emphasis  leads  are  associated  with  Style 
leads  provoked  an  additional  question:  How  is  it  that  one 

source  comes  to  anticipate  the  emphases  of  another?  More  spe- 
cifically, how  is  it  that  the  target  nation's  view  of  the 
actor's  emphases  happens  to  precede  the  actor's  own  view  of 

i 

its  emphases,  which  is  the  case  we  have  in  our  data?  The  fol- 
lowing section  reports  on  an  explanation  that  was  advanced  and 
examined . 


Are  emphasis  leads  associated  with  differential  coverage 
of  bureaucratic  actors? 


It  seems  very  likely  that  the  upper  echelons  of  foreign  policy 
bureaucracy--including  the  head  of  government --would  initiate 
trends  in  the  focus  of  policy  actions,  which  trends  subsequently 
would  be  realized  at  lower  levels  of  bureaucracy.  This  has  the 
implication  that  if  two  sources  are  reporting  the  policy  state- 
ments and  actions  of  a nation,  the  source  deriving  a greater 
proportion  of  its  reports  from  the  higher  bureaucratic  levels 
would  lead--in  subject  emphasis--a  source  deriving  a higher  pro- 
portion of  its  reports  from  the  lower  levels.  We  examined  this 
implication  by  asking  whether,  in  our  data,  the  subjects  on  which 
a source  has  an  emphasis  lead  also  are  characterized  by  that 
source  focusing  its  attention  on  higher  bureaucratic  levels  more 
than  the  source  that  it  leads. 

From  the  previous  section  it  is  known  that  the  two  greatest  em- 
phasis leads  out  of  the  five  dyad-subject  combinations  considered 
are:  (1)  NYT  leads  TOL  in  the  Defense  subject  in  the  UK— *US  dyad; 

and  (2)  TOL  leads  MYT  in  the  Economic  affairs  subject  in  the 
US— >UK  dyad.  Therefore,  we  would  expect,  according  to  the  im- 
plication above,  that: 

i 

1 
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1.  in  the  UK—»US  dyad,  NYT  reports  a greater  percentage 
of  defense  events  from  higher  bureaucratic  levels  than 
the  percentage  TOL  reports;  and 

2.  In  the  US-*UK  dyad,  TOL  reports  a greater  percentage 
of  economic  affairs  events  from  higher  bureaucratic 
levels  than  the  percentage  NYT  reports. 

We  considered  the  President,  his  foreign  policy  adviser  and 
cabinet  members  to  comprise  upper  levels  for  the  US,  and  the 
Prime  Minister  and  his  ministers  and  secretaries  to  constitute 
upper  levels  for  the  UK.  Lower  level  actors  in  each  case  in- 
clude undersecretaries,  representatives  to  talks  and  negotia- 
tions, and  so  forth.  Table  22  shows  that  the  two  expectations 
are  borne  out  by  the  data. 


Table  22  shows  that  the  two  greatest  cases  of  emphasis  lead 
are  also  cases  in  which  the  leading  source  reported  a greater 
percentage  of  events  from  the  higher  bureaucratic  levels. 

We  would  also  expect  the  percentages  to  differ  between  the  two 
sources  less  on  the  remaining  three  dy ad- sub j ects  discussed 
in  the  previous  sections,  for  emphasis  leads  were  less  noticea- 
ble in  these  three  cases.  Table  23  shows  that  there  were  some 
differences,  and  one  of  these  (defense  in  the  US-+UK  dyad)  was 
greater  than  one  of  the  differences  in  Table  22,  while  the 
other  two  differences  are,  as  expected,  less. 

Thus,  one  case  out  of  the  five  is  contrary  to  the  idea  that  one 
source  will  lead  another's  subject  emphasis  to  the  extent  that 
its  attention  is  focused  relatively  more  upon  higher  bureaucratic 
levels.  Considering,  however,  that  four  out  of  five  cases  were 
consistent  with  the  idea,  we  can  say  there  is  an  imperfect  ten- 
dency in  the  expected  direction  of  the  relationship.  Such  a 
tendency  is  adequate  at  this  state  of  MDS  research  to  suggest 
further  explorations  along  these  lines. 
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TABLE  2 2 . 

Source  Emphases  on  Higher  Bureaucratic  Levels 


Dyad  Subject 
US-^UK  Economic 


UK— >US  Defense 


Percent  of  Events 

From  Higher  Levels 

NYT 

TOL 

44 

80 

82 

60 

TABLE  23. 

Source  Emphases  on  Higher  Bureaucratic  Levels 


Percent  of  Events  from  Higher  Levels 


Dyad  | Subject 


US— >UK  Defense 


UK— >US  Economic 


UK— ^US  General  Relations 


100 

72 

84 

66 

75 

70 
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The  main  implication  of  the  foregoing  is  that: 

• A nation  increases  its  chances  of  correctly  anticipating 
another's  view  of  subject  emphases  by  focusing  irs 
attention  on  the  other's  high  level  foreign  policy  actors. 


Fow  do  US  and  UK  view  the  quality  of  interaction  between 
other  pairs  of  countries  as  conveyed  by  NYT  and  TOL? 


This  question  is  different  in  an  important  respect  from  those 
posed  previously.  Here,  US  and  UK  are  both  observers  rather 
than  participants  in  the  interaction.  The  opportunity  exists, 
therefore,  to  compare  US  and  UK  observations  of  signals  emitted 
elsewhere,  and  to  see  how  similar  and  different  are  their  re- 
sulting views  across  time. 

Eight  cases  were  selected  for  examination.  These  cases  consist 
of  pairs  of  countries  having  a current  or  past  history  of  local 
conflict  and/or  periodic  crisis.  For  all  these  cases  it  is  of 
interest  to  examine  the  overall  correspondence  between  views 
separately  emanating  from  NYT  and  TOL . In  addition,  for  certain 
of  the  cases,  where  overall  correspondence  is  low  or  when  the 
views  differ  in  other  respects  it  is  of  interest  to  seek 
interpretation. 

Table  24A  and  its  continuation,  Table  24B,  present  plotted  time 
series  of  relations  between  each  of  the  eight  country  pairs, 
as  derived  from  both  NYT  and  TOL . Relations  (R)  values  appear- 
ing in  the  displays  are  computed  each  three  months  for  the  pre- 
vious 12  month  time  period.  For  example,  the  first  R value  in 
each  curve  {at  6/72)  is  based  on  events  reported  from  mid-1971 
through  mid-1972,  the  second  R value  is  based  on  events  reported 
from  October  1971  through  September  1972,  and  so  on 
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Correspondence  between  the  two  sources  is  suggested  by 
absolute  difference  in  R values  at  each  point  in  time,,/! 


(Kl) 


These  values  appear  below  each  graphical  display.  A measure 
of  the  overall  correspondence  in  views  between  the  two  sources 
is  the  mean  of  I D | . These  mean  values  are  presented  in 


Table  25,  where  the  pairs  are  ranked  from  closest  correspon- 
dence to  least  correspondence.  The  maximum  |°R|  i-s  2.0.  Based 
on  this  statistic  alone  it  would  appear  that  there  is  good 
correspondence  between  NYT  and  TOL  in  six  of  the  eight  cases. 

But  it  is  clear  from  inspecting  the  graphical  displays  and  the 
individual  values  of  |°Rj  that  correspondence  varies  considerably 
within  cases.  For  example,  in  the  case  UAR-1SR  there  is  im- 
portant lack  of  correspondence  during  the  9 month  period  prior 
to  the  last  quarter  of  1973,  when  the  Yom  Kippur  War  occurred. 

In  this  case,  in  retrospect,  NYT  was  a better  predictor  of  the 
likelihood  of  conflict  occurring.  On  the  other  hand,  in  the 
case  of  KOS-KON,  close  correspondence  exists  in  the  latter 
stages  of  the  time  series.  But  in  this  instance  TOL  was  an 
earlier  harbinger  of  the  attempt  at  reconciliation  between  this 
pair.  The  same  is  true  with  respect  to  GMW-GME,  where  treaty 
preparations  in  the  early  part  of  the  period  were  viewed  more 
positively  by  NYT  than  TOL . Both  source  views  converge  later 
into  close  correspondence. 

What  is  suggested  here  is  that  correspondence  in  observation  is 
neither  necessarily  continuous  nor  desirable.  In  multiple  data 
stream  analysis,  temporary  incongruence  in  views  takes  on  im- 
portance in  signalling  differences  in  interpretation  of  inter- 
national affairs. 


The  implications  of  this  analysis  then  for  the  US  are  that  two 
(or  more)  views  based  on  separate  observation  of  foreign  affairs 
can  provide  signals  of  changes  underway  or  in  prospect  that 
might  be  absent  or  ignored  as  components  of  a single  view. 
Therefore,  continuous  monitoring  of  multiple  data  streams  for 


Country  Pair 

Overall  Correspondence  in  View 

N 

ISR-SYR 

.02 

VTS-VTN 

.07 

USR-CPR 

. 07 

ISR- JOR 

o 

CD 

PAK-IND 

. 14 

UAR-ISR 

.16 

GMW-GME 

. 2 3 

KOS-KON 


. 30 


selected  country  pairs  can  prompt  timely  searches  for  and  ex- 
amination of  explanations  when  incongruence  between  views 
occurs . 

i 

Since  our  assumption  is  that  two  countries  which  observe  and 
interpret  international  interactions  differently  (e.g.,  as  in 
the  UAR-ISR  or  KOS-KON  cases)  may  be  expected  to  behave  dif- 
ferently, then  a further  implication  exists.  That  is,  the 
likelihood  of  mutual  attention  to  and  similar  actions  toward 
a situation  by  US  and  UK  is  diminished  to  the  extent  that  their 
views  of  the  urgency  of  and  inherent  quality  of  the  situation 
differ.  Multiple  data  stream  analysis  can  alert  the  analyst  to 
the  basis  for  differences  in  view  and  help  to  estimate  the  po- 
tential for  agreement  or  joint  action  in  the  situation. 


What  are  the  alignments  of  US  and  UK  toward  selected 
other  countries  and  conflict  pairs  as  conveyed  by 
NYT  and  TOL? 


Alignment  is  an  important  and  complex  concept  in  foreign  affairs. 

In  the  context  of  event  data,  Alignment  may  be  represented  by: 

1.  the  similarity  between  two  countries  in  the  friendly 
to  hostile  quality  of  their  behavior  toward  other 
countries.  For  example,  by  assessing  how  similar  in 
quality  are  the  separate  actions  of  US  and  UK  toward 
China  the  informal  alignment  of  US  and  UK  relative  to 
China  may  be  inferred. 

2.  the  similarity  of  the  behavior  of  one  country  toward 
two  other  countries.  For  example,  by  assessing  how 
similar  are  the  actions  of  UK  toward  the  US  and  USSR 
the  relative  alignment  of  UK  to  each  may  be  inferred. 


These  concepts  are  susceptible  to  more  meaningful  measurement 
and  interpretation  with  multiple  data  streams  than  with  a single 
source  of  data.  With  multiple  data  streams  it  is  possible  to  use 
an  indigenous  source  to  represent  a country's  own  behavior,  e.g.. 
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TOL  may  represent  signals  of  UK  behavior  and  NY T signals  of 
US  behavior.  With  only  a single  source,  say  NYT , the  Alignment 
concept  can  be  measured  only  by  combining  signalled  (US)  be- 
havior with  observed  (UK)  behavior.  This  type  of  combination, 
however,  might  be  expected  to  yield  the  US  view  of  the  Alignment 
By  contrasting  single  and  multiple  source  measurements,  it  is 
possible  to  identify  cases  where  similarities  and  differences 
appear  to  exist  between  implied  US  and  UK  impressions  of 
Alignment. 


Table  26  presents  scores  indicating  the  degree  of  .Alignment 
between  the  US  and  UK  toward  21  target  countries.  The  Align- 
ment score  is  the  arithmetic  difference  between  the  Policy  Style 
of  the  US  and  UK  toward  each  target.  In  the  table,  the  UK  Style 
value  is  subtracted  from  the  US  value  in  all  cases.  Therefore, 
positive  Alignment  scores  indicate  that  UK  behavior  toward  the 
target  is  more  positive  than  US  behavior.  Negative  scores  in- 
dicate the  opposite.  The  maximum  range  of  this  indicator  of 
Alignment  is  ±2.0  (e.g.,  a score  achieved  when  one  actor's 

Policy  Style  is  +1.0  and  the  others'  is  -1.0  toward  a target). 
Given  the  generally  mutual  and  supportive  interests  of  US  and 
UK,  it  might  be  expected  that  relatively  low  scores  (close 
Alignment)  would  predominate. 


rable  26  presents  one  to  three  Alignment  scores  for  each  target, 
iepending  on  whether  the  data  were  sufficient  for  the  necessary 
calculations.  The  column  "signalled  views"  reflects  the  Policy 
Styles  of  each  indigenous  source  toward  the  target,  i.e.,  the 
Style  of  US— ^Target  calculated  from  NYT  data  minus  the  Style  of 
UK— ^Target  calculated  from  TOL  data.  The  "US  \ iew  and  UK  view 
scores  are  based  on  Policy  Style  values  for  single  sources, 

NYT  and  TOL,  respectively.  The  targets  are  ranked  in  the  table 
from  those  toward  whom  the  signalled  view  of  US-UK  Alignment  is 
closest  to  those  toward  which  it  is  most  distant.  In  the  tabic, 
the  signalled  view  of  Alignments  between  US  and  UK  are  •’enerally 
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Target 

Country 

Signalled 

View 

US 

View 

UK 

View 

JOR 

0 

-.09 

CPR 

.02 

-.02 

-.02 

POL 

.03 

. 33 

ITA 

-.05 

-.17 

JAP 

-.06 

.01 

-.21 

GRC 

-.10 

. -.10 

FRN 

.11 

.51 

-.33 

GMW 

-.11 

.29 

.12 

PAK 

.11 

IRN 

-.15 

CHL 

.17 

.15 

UAR 

.23 

1 

o 

kD 

.16 

IRQ 

-.25 

SAU 

-.25 

-.24 

GME 

.27 

AUL 

.31 

-.59 

INS 

. 33 

ISR 

-.34 

-.52 

-.18 

IND 

.44 

.63 

USR 

CO 

-.39 

CT> 

CM 

1 

TUR 

-1.03 

a 


as  expected,  i,e. , the  scores  tend  to  be  relatively  low.  The 
ordering  of  targets  in  terms  of  closeness  of  Alignment  between 
US  and  UK  appears  to  be  intuitively  proper,  as  well. 


Of  more  interest,  from  the  standpoint  of  MDS  analysis,  are  the 
differences  among  the  scores  for  certain  cases.  For  example, 
close  US-UK  Alignment  is  signalled  toward  France,  with  UK 
slightly  more  positive  than  US  (.11).  The  US  view,  however, 
shows  UK  considerably  more  positive  toward  France  (.55),  while 
the  UK  view  is  the  opposite,  with  US  significantly  more  posi- 
tive (-.33) . Also,  for  example,  in  the  case  of  Israel,  the  UK 
view  is  that  it  is  nor.  nearly  so  much  more  negative  (-.18)  than 
the  US  view  (-.52)  or  the  signalled  view  (-.34).  Finally,  in 
the  case  of  USR  neither  the  US  view  nor  the  UK  view  match  the 
signalled  degree  of  relative  UK  negativeness. 


The  implications  of  this  kind  of  analysis,  assuming  once  more 
that  NYT  and  TOL  are  appropriate  surrogates  for  official  views , 
and  that  such  views  are  precursory  to  later  behavior,  are  that 
multiple  observations--from  different  points  of  view— can  pro- 
vide insights  and  inferences  relative  to  prospective  benavior 
which  are  not  inherent  in  any  single  set  of  observations. 


A second  aspect  of  the  Alignment  concept  deals  with  the  degree 
to  which  one  country  differentiates  between  two  (or  more)  others. 
For  example,  in  Cold  War  rhetoric  it  became  conventional  to 
attempt  to  categorize  countries  as  being  aligned  with  the  US, 
or  with  the  USSR,  or  being  "neutrals". 


This  notion  may  be  measured  by  employing  the  Policy  Styles  of 
a country  toward  two  other  countries  which  themselves  are  cen- 
tral to  some  issue  arena.  In  Table  27  the  Alignments  of  UK 
relative  to  eight  pairs  of  countries  which  represent  distinct 
issue  arenas  are  shown.  The  Policy  Style  of  UK  to  each  pair 
member  based  on  TOL , is  displayed  in  the  first  column  of  the 
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table.  The  second  column  displays  the  Alignment  score,  which 
in  this  instance  is  the  absolute  arithmetic  difference  between 
UK  style  values  to  each  pair  member.  The  pairs  are  listed  in 
the  table  from  the  lowest  Alignment  score  to  the  highest.  A 
low  score  means  that  UK,  in  its  own  view  (TOL) , does  not  dif- 
ferentiate significantly  between  the  pair , or  implicitly,  in 
the  issue  arena.  Higher  scores  indicate  that  differentiation 
does  exist,  i.e.,  that  UK  is  more  closely  aligned  with  one  of 
the  pair  than  the  other.  The  maximum  possible  score  for  this 
index  is  2.0.  Reference  to  the  Policy  Style  values  in  the 
table  indicates  with  which  country  UK  Alignment  exists  and  the 
na  ,ure  of  the  Alignment. 


For  example,  in  the  case  of  USR-CPR,  UK  views  itself  supportive 
of  CPR  (S— .31)  and  opposing  USR  (S=-.24)  for  an  Alignment  score 
for  this  pair  of  .55.  For  UAR-ISR,  the  Alignment  score  is  vir- 
tually as  high  (.50) , but  is  qualitatively  different.  In  this 
case  UK  views  itself  as  supportive  of  UAR  (S=.50)  and  neutral 
toward  ISR  (S=0).  At  the  other  extreme,  FRN-GMW  is  a case  in 
which  UK  shows  little  differentiation  in  behavior  between  the 
pair  members  (.13),  i.e.,  it  does  not  align  significantly  with 

either  pair  member,  while  being  essentially  neutral  toward 
FRW  (S=.04)  and  mildly  supportive  of  GMW  (S=.17)  . 


The  implication  of  this  analysis,  of  course,  is  that  if  a 
media  source  can  be  used  as  surrogate  for  governmental  position 
then  a source  indigenous  to  any  country  can  be  used  to  locate 
its  country's  Alignment  position  relative  to  significant  world 
issues.  Furthermore,  given  sufficiently  long  streams  of  data 
from  multiple  sources  there  is  no  reason  why  trends  and  changes 
in  these  Alignment  postures  cannot  be  represented  in  addition 
to  the  static  thirty-six  month  illustrations  employed  here. 


51 


i 


FUTURE  ACTIVITIES 


The  foregoing  section  has  illustrated  the  principal  similarities 
and  differences  in  national  attention,  interest  and  point  of 
view  that  are  inherent  in  the  observation  of  international  affairs 
from  different  national  perspectives,  and  which  may  be  revealed 
by  applying  MDS  techniques  of  analysis. 

What  remains  to  be  done  in  completing  this  initial  illustration 
of  the  MDS  approach  is  to  address  the  question  of  the  utility 
of  the  approach  to  the  national  security  community  more  directly. 
To  this  end,  it  is  planned  to  focus  on  a particular  region 
(e.g.,  the  Middle  East)  or  a problem  (e.g.,  energy)  and  analyze 


it  in  detail  . 


£■ 


STATUS  OF  SHORT  TERM  FORECASTING  RESEARCH 


Historical  analogies  are  frequently  used  as  the  basis  for  judg- 
mental forecasts.  Specifically,  if  the  dimensions  of  a current 
situation  are  perceived  to  be  similar  to  those  of  some  previous 
situation,  then,  other  things  equal,  the  probable  outcome  of 
the  current  situation  is  assumed  to  be  similar  to  the  actual 
outcome  of  its  past  analogue.  The  premise  of  such  forecasting 
is  that  behavioral  patterns  exist  independent  of  their  time 
and  place  of  occurrence.  In  this  sense  history  is  assumed  to 
be  repetitive  and,  therefore,  to  provide  a basis  for  prediction. 

In  its  quantitative  form,  this  approach  to  forecasting  may  be 
pursued  both  by  univariate  time  series  analysis  and  by  multi- 
variate cross-sectional  analysis.  Univariate  time  series  ana 
lysis  limits  attention  to  a single  variable-- that  one  for  which 
a forecast  is  sought--and  employs  a large  number  of  cases  to 
segregate  historical  patterns  and  their  outcomes.  The  unique 
distribution  of  outcomes  associated  with  an  historical  pattern 
is  employed  as  the  probabilistic  forecast  distribution  for 
cases  which  currently  conform  to  the  same  pattern. 

In  previous  ARPA  supported  research,  the  first  attempts  at 
translating  this  forecasting  approach  to  quantitative  terms 
yielded  promising  results.1  Time  series  analysis  of  the  his- 
tories of  Relations  and  Policy  Style  measures  for  sizeable  sam- 
ples of  country  pairs  revealed  past  patterns  of  behavior  which 
were  associated  with  statistically  significant  differences  in 
subsequent  outcomes.  One  set  of  objectives  of  the  present  short 

1See  Preliminary  Investigation  of  a Technique  for  the S h o r_t 

Term  Forecasti ng  of  Selected  International  Indicators  , 
International  Affairs  Center,  CACI,  ±nc. 
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term  forecasting  research  is  to'  attempt  to  replicate  and  extend 
the  earlier  results,  validate  forecasts  based  on  the  results, 
and  demonstrate  the  utility  of  the  forecasting  technique. 

In  addition  to  univariate  patterns  across  time,  analogies  may 
also  be  drawn  from  cross-sectional  patterns  across  multiple 
variables.  In  the  first  instance,  time  is  the  patterning  di- 
mension for  a single  vari able . In  the  latter  instance,  the 
values  of  multiple  variables  are  assumed  to  pattern  at  discrete 
moments  in  time. 


f 
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The  cross-sectional  approach  has  a special  attribute.  It  per- 
mits the  composite  of  values  of  several  variables  to  represent 
a complex  phenomenon.  For  example,  we  do  not  yet  have  a satis- 
factory means  to  detect  the  onset  of  crisis  between  countries. 
Bu 1 we  can  represent  crises  known  to  have  occurred  in  terms  of 
variables  which  have  been  measured.  That  is,  we  might  identify 
recent  crises  which  have  occurred,  stipulate  all  the  measurable 
variables  we  believe  to  be  of  relevance  to  crisis,  and  deter- 
mine which  of  these  variables  have  "special"  values  preceding 
tne  crises  in  question. 
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Those  variables  and  values  represent  a pattern  of  conditions 
which  can  be  used  to  define  the  precursor  analogue  of  crisis. 
Future  crises,  then,  may  be  forecast  when  similar  patterns  of 
conditions  are  observed  currently.  A second  set  of  objectives 
of  the  present  short  term  forecasting  research  is  the  prelim- 
inary development  and  illustration  of  this  multivariate  ap- 
proach. This  research  may  be  considered  successful  if  a unique 
set  of  variables  and  values  is  generally  found  to  be  present 
in  temporal  proximity  to  the  crisis  cases  but  rarely  in  proxi- 
mity to  other  cases. 
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IND INGS-  - UNI  V A R'l  ATE  TIME  SERIES  ANALYSIS 


research,  five  historical  patterns  were  found 
ries  of  the  Relations  (R)  and  Policy  Style  (S) 

These  patterns  were  associated  with  different  and 
lly  significant  distributions  of  the  subsequent 
R and  S . 


ical  patterns  were  found  by  examining  three  variables: 

he  average  fluctuation  of  all  time  series  values 
round  the  most  current  value  (P)  , 

he  magnitude  of  the  difference  between  the  beginning 
nd  most  current  value  (D) , and 

he  uniformity  in  the  direction  of  change,  if  any, 
rom  the  beginning  to  the  current  value  (U)  . 


patterns  manifest  the  folio wing  characteristics  in 
these  three  variables: 


Pattern 

F 

D 

U 

1 . 

<.10 

< .2 

not  relevant 

2 . 

>.10  <. 20 

> . 2 

yes 

3 . 

> . 10  <.20 

any  value 

no 

4 . 

> . 20 

> -2 

yes 

5 . 

o 

CN 

any  value 

no 

ely 


the 


patterns  may  be  described  as  follows: 


:rn 


#1: 


Time  series  values  fluctuate  little  and  change 
little  from  beginning  to  end.  This  pattern 
may  be  referred  to  as  Stable. 


;rns  #2  and  #4:  Time  series  values  have  moderate  (#2) 

or  high  (#4)  fluctuation,  combined  with  a sig- 
nificant change  in  level  (D)  from  beginning  to 
end  which  proceeds  uniformly  in  direction, 


i 
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i.e.,  without  reversal.  These  patterns  may 
be  referred  to  as  Moderate  (#2)  and  Major  (#4) 
Leve 1 Changes . 

Patterns  ft  3 and  #5:  Time  series  values  have  moderate  (#3) 

or  high  (#5)  fluctuation,  which  occurs  without 
apparent  pattern  and  with  no  uniformity  in 
direction.  These  patterns  may  be  referred  to 
as  Moderately  (#3)  or  Highly  (#5)  Unstable. 


In  the  experiments  involving  time  series  of  the  Relations  mea- 
sure (R) , based  on  74  cases  (pairs  of  countries) , the  subsequent 
distributions  of  Ar  across  the  patterns  were  found  to  be  signi- 
ficantly different.  Ar  is  the  change  in  the  value  of  R between 
the  end  values  of  the  historical  time  series  and  a period  24 
months  later.  The  values  of  AR  were  classified  as: 

• Low,  where  Ar  ^ 

• Medium,  where  Ar>±.2^.±.41 

• High,  where  Ar  > dt  . 4 

Table  28  presents  the  Ar  distributions  for  the  74  cases  for 
each  of  the  five  patterns.  In  Table  29  these  distributions  are 
converted  to  percentages. 


The  percentage  distributions  in  Table  29,  are,  in  effect,  proba- 
bility distributions  of  future  outcomes  associated  with  each 
pattern.  As  such,  they  may,  in  the  absence  of  other  information 
or  in  combination  with  it  be  used  as  the  likely  outcome  dis- 
tributions for  cases  which  currently  conform  to  each  of  the  his- 
torical patterns.  That  is,  we  can  use  these  distributions  as 
estimates,  or  forecasts,  of  likely  changes  in  Relations  over 
the  next  two  years  between  country  pairs  whose  past  analogue 
we  may  calculate  empirically. 

It  is  worth  noting  that  the  distributions  in  Table  29  seem  in- 
tuitively correct  in  the  following  ways: 

''"A  Ar  value  of  .2  equals  a change  of  10%  of  the  R scale,  which 
ranges  from  +1.0  to  -1.0;  a AR  value  of  .4  equals  a charge  of 
20%  of  the  R scale. 
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TABLE  28. 

Frequency  Distribution  of  AR  by  Historical  Pattern 
for  74  Country  Pairs 


Pattern 

Number 

of 

Cases 

AR  (24  months) 

Low 

Medium 

High 

1 . Stable 

20 

14 

4 

2 

2. Moderate  level  change 

9 

7 

2 

0 

3. Moderately  unstable 

17 

5 

7 

5 

4. Major  level  change 

14 

7 

4 

3 

5. Highly  unstable 

14 

3 

4 

7 

TOTAL 

74 

36 

21 

17 

57 


} 

t 
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1.  Pairs  with  stable  histories  of  Relations  (Pattern  #1) 
are  shown  to  be  inclined  to  remain  stable. 

2.  Pairs  whose  Relations  change  moderately  in  level 
(Pattern  #2)  are  shown  to  exhibit  a tendency  toward 
stability  at  the  new  level.?  pairs  whose  Relations 
chanqe  drastically  in  level  (Pattern  M ) are  also 
inclined  to  stabilize  at  the  new  level,  but  there  is 
also  a significant  tendency  to  "rebound". 

3.  Pairs  whose  Relations  are  unstable  (Patterns  #3  and 
#5)  tend  to  bo  the  least  "predictable";  i.e.,  for 
Pattern  #3  in  particular  the  future  is  almost  totally 
uncertain.  Pattern  #5,  which  reflects  wide  past  fluc- 
tuations in  Relations  also  shows  the  greatest  tendency 
toward  large  future  changes. 


It  should  also  be  noted  here  that  identical  patterns  and  highly 
similar  distributions  of  subsequent  change  were  found  when  the 
experiment  was  extended  to  the  Policy  Style  (S)  measure.  In 
that  experiment,  85  country  pair  cases  were  employed. 

These  results  prompted  a series  of  questions  which  have  been 
and  are  being  addressed  in  current  research  on  univariate  time 
series  analysis.  The  questions  dealt  with  to  date  are  stated 
below  along  with  related  findings. 

How  representative  was  the  distribution  of  Ar  for 
the  case  sample  employed  to  develop  the  historical 
patterns  ? 

The  74  cases  employed  in  previous  experiments  with  the  Relations 
measure  were  not  randomly  chosen.  The  sample  was  constrained 
in  two  dimensions.  First,  because  of  limited  time  series 
lengths  (1966  through  1972),  each  country  pair  contributed  only 
one  Ar  value.  That  is,  the  historical  time  series  covered  the 
period  1966-1970  and  Ar  was  measured  for  1971  plus  1972?  five 
years  of  history  was  employed  to  make  a two  year  forecast. 
Therefore,  the  case  sample  reflects  changes  in  Relations  for  a 
wide  array  of  country  pairs  but  for  just  one  time  period,  1971 
plus  1972. 


Second,  the  country  pairs  employed  were  limited  to  pairs  of 
individual  countries  (e.g.,  USA  and  USSR).  Since  the  Relations 
measure  may  be  computed  for  groups  of  countries  as  well  (e  g., 

USA  and  the  World,  or  NATO  and  Warsaw  Pact  Countries,  or  all 
Arab  Countries) , or  may  be  computed  within  country  pairs  by 
subject  or  issue  (e.g.,  Military  Relations  between  USA  and  USSR) 
the  potential  sample  could  have  been  differently  constituted. 

In  Table  30  the  percentage  distributions  of  Ar  across  two  year 
periods  are  recorded  for  the  original  sample  (Sample  1)  and 
for  two  additional  samples,  chosen  to  test  the  consistency  of 
th  e Ar  distribution  by  eliminating  the  above  sampling  constraints. 
Sample  2 consists  of  all  24  month  changes  in  R throughout  the 
available  time  history  for  the  original  74  country  pair  cases. 
Sample  3 consists  of  the  Ar  distribution  over  the  original  time 
period  (1971  plus  1972)  but  for  a composite  of  69  pairs  of 
country  groups  and  issues  with  country  pairs. 

The  table  shows  that  for  74  country  pairs  the  1971-1972  Ar 
distribution  (Sample  1)  was  almost  identical  to  the  distribution 
across  the  entire  time  history  (Sample  2).  The  implication  here 
is  that  had  any  sample  of  time  periods  for  country  pairs  been 
chosen  randomly  the  Ar  distribution  would  have  been  similar  to 
that  in  the  original  sample  employed.  On  the  other  hand  the 
AR  distribution  for  country  pairs  and  issue  pairs  (Sample  3) 
differs  somewhat  from  the  others.  Specifically,  for  pairs  of 
this  type  there  seems  to  be  less  of  a tendency  toward  high  Ar 
and  more  of  a tendency  toward  medium  Ar  than  in  the  country  pair 
samples.  This  finding  suggests  either  that  the  historical  pat- 
terns for  pairs  of  these  types  differ  from  those  for  country 
pairs  or  that  the  same  patterns  yield  somewhat  different  dis- 
tributions of  Ar  for  forecasting  purposes. 
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TABLE  30. 

Distribution  of  AR  For  Three  Samples 


( 


Sample 


1.  Original  sample 

(74  country  pairs, 
one  time  period) 


2.  74  country  pairs, 
all  time  periods 


Percentaae  Distribution  of  Ar 


Total 


100 


100 


Low 


49 


50 


Medium 


High 


28 


28 


3.  Composite  sample  of 
country  groups  and 
issues 

(69  pairs,  same  one 
time  period  as 
original  sample 


100 


46 


41 
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What  are  the  historical  patterns  and  Ar  distribu- 
tions for  country  qroup  pairs  and  issue  pairs? 


Tables  31  and  32  show  the  frequency  and  percentage  distributions 
of  Ar  , respectively,  for  the  composite  country  group  and  issue 
sample  of  69  pairs.  Ar  covers  the  1971  plus  1972  time  period, 
the  same  period  employed  in  the  original  experiments.  By  com- 
paring the  distributions  in  Table  32  with  those  presented  ear- 
lier in  Table  29  the  difference  between  country  pairs  and 
country  groups  may  be  seen. 


It  is  interesting  to  note  that  the  Ar  distributions  for  Pattern  1 
are  quite  similar  for  both  samples.  Specifically,  cases  with  a 
stable  history  tend  to  manifest  low  propensity  for  change.  On 
the  other  hand,  where  a moderate  or  major  level  change  occurred 
historically  (Patterns  2 and  4)  the  dominant  ensuing  change  for 
country  group  and  issue  pair  cases  is  a moderate  subsequent 
change  in  R,  whereas  in  the  country  pair  sample,  this  pattern 
had  been  followed  with  stability  of  R near  the  new  level.  Fi- 
nally, the  country  group-issue  pair  sample  shows  less  tendency 
toward  high  changes  in  R for  cases  which  were  historically  un- 
stable (Patterns  3 and  5).  These  cases,  however,  like  those  in 
the  original  sample,  are  less  predictable  than  cases  manifesting 
any  other  pattern,  i.e. , Ar  is  more  equally  distributed  across 
the  low,  medium,  and  high  ranges  of  subsequent  values  than  it 
is  for  any  other  pattern. 

The  implication  of  these  findings  is  that  while  historical 
patterns  may  be  similarly  deduced  for  different  kinds  of  case 
samples,  the  subsequent  Ar  distributions  may  be  sufficiently 
different  that  their  use  for  forecasting  must  be  restricted  to 
like  cases . 
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Number 

of 

Cases 


TABLE  32. 

Percentage  Distribution  of  Ar  by  Historical  Pattern 
for  69  Country  Group  and  Issue  Pairs 


Percentage  Distribution  of 

Ar 

Pattern 

Total 

Low 

Medium 

High 

1.  Stable 

100 

60 

30 

10 

2.  Moderate  level  change 

100 

33 

67 

0 

3.  Moderately  unstable 

100 

53 

20 

27 

4.  Major  level  change 

100 

45 

55 

0 

5.  Highly  unstable 

100 

29 

53 

18 

TOTAL 

100 

46 

41 

13 

How  can  the  direction  was  ’oil  as  the  magnitude 
of  change  for  R be  forecas  ? 


In  previous  experimentation  with  univariate  time  series,  sam- 
ples have  not  been  sufficiently  large  to  permit  isolation  of 
the  direction  of  Ar  by  historical  pattern.  Forecasts  based 
on  Ar  distributions,  therefore,  refer  only  to  magnitudes  of 
likely  change. 

It  seems  meaningful  to  assume  that  the  likely  direction  of 
change  in  R would  be  associated  to  some  degree  with  the  base 
of  R,  i.e.,  that  value  from  which  the  change  is  measured.  It 
may  be  reasoned  that  since  the  range  of  R is  scale  constrained, 
i.e.,  R values  may  range  only  from  +1.0  to  -1.0,  that  at  least 
for  high  positive  and  high  negative  base  R values  the  direction 
of  any  change  forecast  would  tend  toward  lesser  values. 

Since  it  would  be  desirable  to  test  this  supposition  with  the 
largest  possible  sample,  the  distribution  of  cases  by  base  R 
values  was  developed  for  both  Sample  1,  the  original  experimen- 
tal case  sample  for  country  pairs,  and  for  Sample  2,  the  same 
country  pair  cases  with  extended  Ar  coverage  (See  Table  30). 

If  these  two  distributions  are  similar  then  it  is  reasonable 
to  use  the  larger  Sample  2 to  explore  the  direction  of  change. 

Table  33  shows  the  frequency  and  percentage  distributions  of 
base  R within  the  two  samples.  For  this  purpose  the  R scale 
is  divided  into  five  ranges  which  may  be  labelled  subjectively 
as  fol lows  : 
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R = 

Country  Pair  is : 

+ .61 

to 

+ 1 . 00 

mutually  supportive 

+ .21 

to 

+ . 60 

friendly 

- . 20 

to 

+ . 20 

neut  ral 

- . 60 

to 

- . 21 

unfriendly 

-1 .00 

to 

- .61 

hostile 

In  Table  33  it  can  be  seen  that  the  percentage  distributions 
of  cases  by  base  R are  virtually  identical  for  Samples  1 and  2. 
Therefore,  we  may  employ  Sample  2 to  examine  direction  of  change. 

For  each  of  the  five  base  R ranges,  Table  34  shows  the  distri- 
bution of  the  624  cases  of  Sample  2 by  direction  of  change  for 
low,  medium,  and  high  AR.  For  example,  the  data  in  the  table 
may  be  read  as  follows:  of  all  cases  in  Sample  2 with  base  R 

values  between  +.61  and  +1.00  and  with  low  Ar  values,  Ar  was 
positive  in  12  cases  and  negative  in  16  cases.  The  table  illus- 
trates, therefore,  the  likelihood  of  positive  and  negative 
change  for  all  combinations  of  base  R and  AR  across  the  entire 
sample  . 

c 

For  convenience  in  interpretation,  these  data  are  expressed  in 
Table  35  as  odds  of  positive  versus  negative  change  for  all 
combinations  of  base  R and  Ar.  For  example,  the  data  in  Table  35 
may  be  read  as  follows:  for  any  case  with  a base  R value  be- 

tween +.61  and  +1.00  and  with  a low  Ar  value,  the  odds  are  1.3 
to  1 that  Ar  will  be  negative. 

There  is  an  interesting  symmetry  in  Table  35  which  bears  out  our 
earlier  supposition.  At  all  ranges  of  base  R except  the  neutral 
range,  the  odds  range  from  equal  (1  to  1)  to  favoring  change 
away  from  extreme  R values  and  toward  neutrality.  Further,  the 
larger  is  Ar  the  more  pronounced  is  this  phenomenon.  Addition- 
ally, however,  it  should  be  noted  that  for  neutral  values  of 
base  R,  the  derived  odds  favor  positive  -hange  for  all  values 

of  Ar. 
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The  odds  on  direction  of  AR  in  Table  35  may  be  used  in  con- 
junction with  the  likely  magnitudes  of  Ar  , such  as  in  Table  29, 
in  the  following  way.  Suppose  a country  pair  for  which  a fore- 
cast of  Ah  is  desired  exhibits  a Pattern  4 time  series  history 
(major  level  change).  According  to  Table  29,  the  percentage 

(probabilistic)  distribution  of  Ar  is: 

• Low  = 50 

• Medium  = 29 

• High  = 21 


Suppose  further  that  the  base  value  of  R (in  this  example,  the 
current  value)  is  +.35.  For  such  a base  R value  the  directional 
odds  for  each  AR  range  (from  Table  35)  are: 


Positive  Negative 

• Low  1 1 

• Medium  1 1.2 

• High  1 4 


It  is  proposed  that  the  above  two  distributions  may  be  combined 
by  applying  the  directional  odds  in  the  second  to  divide  the 
first  between  likelihoods  of  positive  and  negative  changes  as 

follows  : 

Positive  Negative 

(50  x h)  - 25 


• Low 


(50  x *:)  = 25 


Medium  (29  x 


2 . 2 


)=  13 


(29  x = 16 


• -C 

• High 


(21  x 


-)  = 4 


(21  x 


-)  = 17 
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This  results  in  the  following  forecast  distribution  for  the 
example  case  with  its  base  value  of  +.35: 


Forecast  distribution 


Forecast  Ar  range 


Probability 


1. 

high  positive 

> + .75 

4 

2. 

medium  positive 

+.55  to  +.75 

13 

3. 

low  positive 

+.35  to  +.55 

25 

4. 

low  negative 

+.35  to  +.15 

25 

5. 

medium  negative 

+.15  to  -.05 

16 

6. 

high  negative 

>-.05 

17 

In 

proposing  forecast  distributions  of 

this  nature,  the  assump- 

ti 

on  is  always  that  such  forecasts  are 

useful  only  in  the  ab- 

se 

nee  of  other  information,  that  is,  as 

an  alternative  to  unin- 

formed  guessing.  When  other  information  is  available  it  should 
be  used  as  alternative  to  or  in  conjunction  with  these  techniques 
which  solely  reflect  what  has  happened  previously  between  pairs 
with  analagous  histories.  In  forthcoming  validation  experiments 
for  forecasts  based  on  these  statistical  analogies  the  primary 
criterion  employed  will  be  whether  or  not  the  forecasts  are 
superior  to  a blind  guess. 
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STATUS  - MULTIVARIATE  CROSS  SECTIONAL  ANALYSIS 


This  section  describes  a preliminary  design  for  the  investi- 
gation of  multivariate  cross  sectional  analysis  as  a technique 
for  forecasting  short  term  crises,  with  particular  emphasis 


on  crises  involving  the  use  of  military  force. 


RATIONALE 


Under  the  MDS  concept,  forecasting  refers  to  the  anticipation 
of  behavior  through  the  utilization  of  perspectives  inherent 


in  one  or  more  event  data  sources.  In  a strict  sense,  then, 


this  approach  does  not  attempt  to  forecast  behavior  directly. 
When  forecasts  are  constructed,  one  is  instead  quantifying 
an  expectation  about  what  one  or  more  sources  are  likely  to 
report  in  a particular  forecast  period.  To  the  extent  that 
such  expectations  are  realized  in  subsequent  reportage  (that 
is,  are  valid),  and  to  the  extent  that  expectations  about 
behavior  generated  from  each  source  reflect  the  actual  expec- 
tations of  policy  makers  in  the  country  on  which  the  source 
reports,  the  utility  of  event  data  for  measuring  anticipation 
may  well  prove  greater  for  the  policy  community  than  its  utility 
for  measuring  important  forms  of  behavior  directly. 


METHOD 


In  the  present  multivariate  forecasting  efforts,  expectational 
forecasts  are  derived  fromtwo  types  of  historical  analogues. 
First,  historical  precedents  for  individual  country  pairs  are 
used  to  construct  simple  forecasting  variables  for  each  country 
pair  of  interest,  on  the  assumption  that  specific  histc. ical 
patterns  tend  to  be  repetitive  within  pairs.  Still  other 
forecasting  variables  are  constructed  for  each  pair  which 
attempt  to  measure  the  extent  to  which  particular  patterns  are 
being  repeated  or  repudiated  in  proximity  to  specific  forecast 
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periods.  This  latter  set  of  variables  assumes  that  devia- 
tions from  prior  patterns  tend  to  be  incremental  rather  than 
radical  in  character.  These  variables  are  used  to  adjust  each 
pair-wise  forecast  of  event  distributions  for  any  variations 
from  established  patterns  of  interaction  which  occur  immediately 
prior  to  the  forecast  period. 

Secondly,  for  any  group  of  country  pairs  for  which  forecasts 
are  desired,  the  forecasting  variables  are  rank-ordered  and 
weighted  to  yield  a single  score  for  each  pair  in  the  group. 

This  score  is  defined  as  the  relative  crisis-proneness  (CP) 
for  each  pair  for  the  period  being  forecast.  The  rank-ordering 
of  pairs  in  terms  of  CP  scores  constitutes  a simple  typing  of 
pairs  in  terms  of  composite  historical  profiles.  In  contrast 
to  looking  within  each  pair  for  historical  precedents,  this 
second  method  looks  at  pairs  c ro s s -s e c tional ly  over  equal 
historical  intervals  to  determine  overall  similarities,  which 
are  interpreted,  in  turn,  as  relative  expectations  about  the 
onset  of  crisis  involving  military  force  during  the  forecast 
period . 

DEPENDENT  VARIABLES 


Specifically,  for  each  country  pair  in  the  forecast,  two  de- 
pendent variables  are  generated: 

1.  The  expected  distribution  of  friendly  interaction  for 
the  forecast  period,  expressed  as  the  percentage  of 
total  pairwise  interaction  expected  in  each  of^CACI’s 
"unfriendly"  event  groups  (i.e.,  groups  1,2,3)  ; and 


2.  a crisis  proneness  score  for  each  country  pair  by 
which  a rank-ordering  of  country  pairs  from  most 
crisis-prone  to  least  crisis-prone  is  produced. 


The  emphasis  on  event  distributions  rather  than  event  fre- 
quencies as  one  of  the  dependent  variables  is  deliberate, 


"Development  and  Experimental  Application  of  Quantitative 
International  Affairs  Indicators",  Interim  Technical  Report. 
Vol . II,  Technical  Appendices,  September,  1971,  CACI , Inc., 
p . 10 - 10a . 
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given  the  pitfalls  of  accurately  forecasting  the  latter. 

To  the  extent  that  the  distribution  of  unfriendly  events 
for  any  one  country  pair  is  more  stable  over  time  than  the 
pattern  of  event  frequencies  within  unfriendly  event  groups, 
percentage  distribution  would  then  seem  the  better  choice  of 
dependent  variable  especially  since  the  distributions  in  turn 
contribute  to  rank  of  each  country  pair  in  terms  of  crisis 
proneness.  To  the  extent  that  the  expected  distributions 
are  in  fact  more  stable  predictors  of  actual  distributions, 
the  relative  ordering  of  country  pairs  should  be  more 
accurate . 


TIME  SPAN  TO  BE  FORECAST 

I 


The  length  of  the  period  for  which  forecasts  will  be  made  is 
six  months.  While  findings  may  permit  meaningful  forecasts 
to  be  constructed  for  shorter  intervals  of  time,  the  emphasis 
on  distribution  of  unfriendly  events  as  a means  of  forecasting 
seems  to  require  the  use  of  an  interval  greater  than  one  month 
to  determine  whether  particular  forecasts  are  reasonable.  One 
month  may  not  be  sufficient,  in  other  words,  for  the  expected 
distributions  to  become  manifest  in  the  data,  if  indeed  the 
forecasts  are  valid  in  terms  of  this  criterion.  Forecasts 
for  intervals  substantially  greater  than  six  months,  on  the 
other  hand,  may  be  of  little  value  where  expectations  about 
near  term  futures  are  concerned.  Given  these  factors  and  the 
exploratory  nature  of  the  forecasting  variables  defined  below, 
a longer  rather  than  shorter  interval  was  selected. 

In  specifying  the  length  of  the  forecast  period,  we  have  also 
specified  the  data  interval  necessary  for  validating  the 
technique.  A minimum  of  six  months  of  data  is  required  to 
generate  each  forecast,  so  for  the  N YT  collection,  postdiction 

2 

James  A.  Moore  and  Robert  A.  Young,  "Some  Preliminary 
Short-Term  Predictions  of  International  Interaction", 

Working  Paper  #1,  World  Event/Interaction  Survey,  September 
1969,  University  of  Southern  California. 
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exercises  are  possible  for  any  six-month  period  occurring 
between  July,  1966  and  the  end  of  the  collection.  Similarly, 

TOL  postdiction  exercises  are  possible  for  any  six-month 
period  occurring  between  January,  1972  and  June,  1974. 

At  minimum,  the  present  study  will  prepare  and  evaluate  fore- 
casts for  all  non-overlapping  six  month  periods  beginning  in 
July,  1966  for  the  NYT  collection,  and  starting  in  January, 

1972,  for  the  TOL  collection,  with  special  attention  to  fore- 
casts generated  from  different  collections  for  identical  periods. 

FORECASTING  VARIABLES 

The  variables  used  to  construct  forecasts  in  the  present  effort 
are  divided  into  two  classes: 

• pattern  variables,  by  which  is  meant  those  variables 
which  summarize  previous  interactions  between  each 
country  pair  of  interest;  and 

• adjustment  variables,  that  is,  those  variables  which 
express  the  variation  from  established  patterns,  if  any, 
just  prior  to  the  forecast  period  so  that  the  projected 
distributions  of  unfriendly  behavior  may  be  adjusted 
accordingly . 

While  each  class  of  variable  utilizes  event  data  from  previous 
time  points  to  produce  its  forecasts,  the  historical  intervals 
a d underlying  models  differ  for  each.  Pattern  variables 
utilize  one  or  more  unfriendly  event  groups  from  the  beginning 
of  the  collection  through  the  data  month  preceding  the  forecast 
period.  Pattern  variables  thus  assume  that,  for  any  pair,  a 
"perfect  memory"  of  past  interaction  is  important  in  genera- 
ting expectations  about  future  interaction.  In  contrast,  ad- 
justment variables  emphasize  the  variation  away  from  previously 
established  patterns  within  one  or  more  event  groups  over  the 
six  months  immediately  prior  to  the  forecast  period.  Adjust- 
ment variables  assume  that,  for  any  pair,  recent  historical 
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episodes  are  important  in  generating  expectations  to  the  extent 
that  such  episodes  depart  from  long  term  "norms".  For  a given 
pair,  forecasts  are  derived  from  both  classes  of  variables,  and 
each  forecast  can  be  validated  separately.  The  present  design 
thus  affords  the  opportunity  to  compare  a simple  model  of 
forecasting  based  on  "perfect  memory"  with  a second,  competi- 
tive model  based  on  "recent  memory"  in  terms  of  their  respec- 
tive utility  for  forecasting. 

The  pattern  variables  which  have  been  provisionally  selected 
for  use  in  constructing  pair-wise  forecasts  are  defined  below: 

• Negative  event  total,  N,  the  sum  of  pair-wise 
interaction  in  event  groups  1-3,  for  all  time  points 
prior  to  the  forecast  period; 

• Weighted  negative  even  t total,  NW,  the  total  pair-wise 
negative  total  where  the  assigned  weights  are  10,  5 
and  1 for  events  falling  into  groups  1,  2 and  3,  res- 
pectively, for  all  prior  time  points; 


Total  events,  E,  the  total  pair-wise  interaction 
(groups  1-7)  for  a given  pair  for  all  prior  time  points 

Hostility  Ratio,  H,  where  for  each  pair. 


• Weighted  Hostility  Ratio,  Hw,  where  for  each  pair, 

"w  ■ VE! 

• Average  distribution  of  unfriendly  interactions,  P., 

(or  event  groups  1,  2 and  3,  averaged  over  tne 

number  of  time  points  prior  to  the  forecast  period;  and 

• Overall  distribution  of  unfriendly  interactions,  P^, 

for  event  groups  1,  2 and  3,  expressed  as  the 

total  frequency  of  events  in  each  group  divided  by  the 
total  number  of  events  (groups  1-7)  for  all  prior 
time  points. 


Of  the  preceding  variables,  the  first  five  are  designed  to 
maximize  distinctions  between  an  arbitrary  number  of  country 
pairs  when  the  pairs  are  rank-ordered  and  a crisis  proneness 
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score  is  calculated  for  each  pair.  The  pairs  which  tend  to 
rank  highest  on  these  variables  will  tend  to  achieve  the 
highest  CP  scores  for  the  forecast  period. 
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The  distribution  variables  will  also  be  used  to  construct  CP 
scores.  However,  such  variables  have  additional  functions. 
Average  distribution  for  each  of  the  unfriendly  event  groups 
is  used  in  the  construction  of  an  adjustment  variable  as 
defined  below.  Overall  distribution  of  events  across  groups 
1,  2 and  3 represents  the  forecast  generated  for  particular 

pairs  of  countries  under  the  "perfect  memory"  model  outlined 
above.  The  method  of  evaluating  this  expected  distribution  is 
described  below  under  the  heading  of  validation. 


Adjustment  variables  are  defined  as  follows: 

• Adjusted,  weighted,  negative  event  total.  This  variable 
is  defined  as  the  sum  of  the  weighted  differences 
between  the  average  point-to-point  change  in  each  of 

the  negative  event  groups  computed  to  within  six  months 
preceding  the  forecast  period  and  the  frequencies  in 
each  group  observed  during  the  six  months  preceding 
the  forecast  period.  Weights  for  the  differences  between 
long  term  "average"  change  and  short  term  actual  frequen- 
cies are  assigned  in  proximity  to  the  beginning  of  the 
forecast  period,  t,  where  differences  are  weighted 
1,2,3,. ..,6  at  t-6,  t - 5 , t-4,  ...,t-l,  respectively. 

This  variable  is  designed  to  emphasize  atypical  varia- 
tion in  activity  levels  in  each  of  the  three  event 
groups,  weighted  for  importance  by  proximity  to  the 
beginning  of  the  forecast  period.  Positive  values  for 
this  variable  indicate  atypical  increases  in  unfriendly 
activities,  while  negative  values  represent  declining 
levels  of  unfriendly  behavior  in  the  six  months  preceding 
the  forecast  period.  This  variable  is  used  in  the  con- 
struction of  CP  scores  for  each  country  pair  in  the 
forecast . 

• Adjusted,  overall  distribution  for  each  of  the  negative 
event  qroups.  This  variable  is  a function  of  average 
distribution,  defined  previously,  and  actual  negative 
event  group  distributions  for  each  pair  in  the  six  months 
preceding  the  forecast  period.  Its  purpose  is  to 
evaluate  variations  in  each  negative  distribution  in 
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proximity  to  the  forecast  period  and  correct  the  long 
term  distribution  for  important  changes.  The  resulting 
distribution  is  interpreted  as  the  "recent  memory" 
forecast  for  a particular  pair. 

The  exact  construction  of  the  preceding  variables  will  be  dis- 
cussed in  more  detail  in  the  final  report. 


VALIDATION 


The  forecasting  variables  described  above  will  be  computed  for 
all  possible  non-overlapping  six-month  forecast  periods  for 
both  the  New  York  Times  and  Times  of  London  collections.  Selec- 
tion of  country  pairs  for  inclusion  in  the  study  will  be  based 
on  the  level  of  activity  of  the  pair,  the  previous  conflict 
history  of  the  pair,  and  upon  other  similar  considerations. 

The  method  of  evaluating  CP  scores  will  be  to  compare  the 
rank-orderings  of  country  pairs  from  most  crisis  prone  to  least 
crisis  prone  in  each  forecast  period  with  the  rank  orderings 
of  the  pairs  on  (1)  actual  level  of  military  exchanges  in  the 
forecast  period;  and  (2)  actual  level  of  negative  interactions 
(groups  1,2  and  3 combined)  for  each  forecast  period.  Spearman's 
R will  be  used  to  summarize  the  degree  of  agreement  between 
expected  ranks  and  observed  ranks  fcr  each  forecast  period. 

The  Z-test  of  significance  will  be  applied  to  each  rank  corre- 
lation and  evaluated.  The  overall  performance  of  the  CP  score 
as  a forecasting  device  will  be  evaluated. 

In  order  to  evaluate  the  two  sets  of  forecasts  for  unfriendly 
event  distributions,  the  following  procedure  will  be  used.  It 
will  be  recalled  that  for  each  forecast  period,  two  sets  of 
expected  negative  event  group  distributions  are  produced,  one 
set  from  the  pattern  variable  "overall  distribution",  repre- 
senting a perfect  memory  model  of  using  history,  the  second 
set  from  the  adjustment  variable  "adjusted,  overall  distribution", 
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which  we  have  associated  with  a "recent  memory"  model  for 
using  history.  To  assess  the  extent  to  which  the  actual 
numbers  agree,  each  set  of  expected  distributions  will  be 
regressed  against  the  actual  negative  event  distributions 
for  each  forecast  period.  To  the  extent  that  the  distribu- 
tions coincide  numerically,  we  should  expect  that  the  stan- 
da  d regression  equation  y = a + bx  should  yield  values  which 
closely  approach  zero  for  the  intercept  a,  and  values  approx- 
imately equal  to  1 for  the  slope  of  the  regression  line,  b, 
for  each  individual  distribution.  The  model  which  performs 
better  across  all  forecast  periods  constructed  will  be 
adjudged  superior.  The  models  will  be  further  evaluated 
where  separate  collections  generate  forecasts  for  identical 
time  periods,  and  the  implications  for  MDS  analysis  recorded. 


Remaining  tasks  in  this  project  relating  to  short  term  fore 
casting  include: 

1.  Validation  of  forecasts  for  the  1973-1974  period 
derived  from  univariate  time  series  analysis, 

2.  Preparation  and  interpretation  of  a regional  fore- 
cast based  on  univariate  time  series  analysis. 

3.  Implementation  and  evaluation  of  the  multivariate 
research  design  described  herein,  and 

4 Preparation  of  a final  research  report. 
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INTRODUCTION 


Intersource  comparison  and  multiple  source  analysis  have  been 
important  means  by  which  students  of  event  data  have  expli- 
cated, summarized,  and  polemicized  on  the  behavior  of  nations 
in  the  international  arena.  By  comparing  and  suggesting  com- 
binations of  various  sources  they  have  attempted  to  mitigate 
problems  that  have  been  associated  with  the  use  of  single 
sources  (i.e.,  national  biases,  limited  coverage,  unrepresen- 
tative data) . Multiple  source  use  is  expected  to  increase 
the  sheer  volume  of  more  comprehensive,  less  biased  data.  For 
purposes  of  analysis,  multiple  sources  are  expected  to  counter 
the  ambiguities  one  tends  to  find  in  single  sources,  validate 
data  by  multiple  observations,  and  provide  a basis  for  more 
comprehensive  and  reliable  conclusions  on  behavior  in  the 


international  arena. 


The  general  thrust  of  multiple  data  source  research  has  been 
toward  the  objectives  of  increased  comprehensiveness,  vali- 
dation of  observations,  and  bias  reduction.  These  objectives 
have  been  assumed  to  be  desirable,  i.e.,  it  has  been  assumed 
that  resulting  combined  data  collections  would  more  accurately 
-epresent  the  "true"  state  of  international  behavior  and, 
under  analysis,  would  more  likely  yield  reliable  insights 


into  the  future. 


While  we  are  sympathetic  to  such  research  objectives,  we  choose 
to  pursue  multiple  source  comparisons  with  a different  stra- 
tegy to  enhance  the  same  analytic  goal.  This  strategy  is  one 
of  treating  the  insufficiencies  and  parochialism  of  individual 
sources  as  purposeful  and  valuable.  We  assume  that  similari- 
ties and  differences  in  the  representation  of  international 


I 
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behavior  by  different  national  sources  offer  a basis  for  under- 
standing the  similarities  and  differences  in  the  interests  and 
perspectives  of  different  nations,  as  operationalized  by  their 
media.  In  this  strategy,  source  incompleteness  reflects  pri- 
orities of  attention  and  interests,  and  source  bias  reflects 
purposeful  viewpoints.  Instead  of  seeking  the  "true"  state 
of  international  behavior,  we  will  seek  and  compare  perceived 
states  of  behavior  as  reported  by  different  media.  We  term 
this  approach  multiple  data  stream  research. 

In  order  to  develop  techniques  through  which  international 
behavior  as  represented  in  multiple  media  can  be  analyzed, 
s umma rized  and  used  in  the  forecasting  of  defense  related 
phenomena,  it  is  wise  to  take  advantage  of  lessons  learned 
about  the  problems  existing  in  the  use  of  such  sources.  There- 
fore we  have  undertaken  a survey  of  the  existing  literature  on 
multi-source  comparisons.  In  this  paper,  we  seek  to  document 
the  major  thrust  of  such  studies,  their  principle  methods  and 
conclusions,  and  to  determine  the  significance  of  their  find- 
iaa j to  our  pending  analysis. 


I 


PURPOSES  OF  STUDIES;  CHARACTERISTICS  OF  INTERACTION  DATA 


The  purposes  of  analyzing  event  interaction  data  as  it  is 

gleaned  from  multiple  sources  are  varied:  to  assess  the  effects 

of  differential  coverage  on  political  conclusions  of  analy- 
12  3 

ses ; ' ' to  compare  the  attention  of  different  sources  to 

5 , 6 , 7 , 8 

particular  arenas,  conflicts,  and  nations;  to  compare 

4 

coverage  of  wars  between  two  n tions  by  multiple  sources; 
to  discover  whether  one  gains  more  information  on  international 
behavior  from  using  more  tnan  one  source  and,  along  these  lines, 
to  analyze  whether  more  information  necessarily  means  more 
representative  information  and  thus  more  reliable  conclusions. 
The  papers  surveyed  in  the  literature  on  multiple  source  com- 
parisons seek  to  answer  these  and  other  questions. 

Before  reviewing  these  papers,  however,  it  is  important  to 
review  the  notion  of  e ven t- in te r a c t ions , to  suggest  how  this 
notion  may  vary  with  different  kinds  of  sources,  and  how  this 
variation  may  affect  multiple  source  comparisons  and  analyses. 

Event  interaction  data  reflect  the  flow  of  actions  and  res- 
ponses (or  behavior)  between  nations.  Based  on  the  assump- 

* 

tion  that  there  are,  as  McClelland  holds,  "continuities  and 
regularities  in  the  international  political  behaviors  of 
nations..."  one  must  study  this  behavior  i .i  the  international 
system  in  order  to  enable  one  to  predict  behavior. 

McClelland  differentiates  between  event  interactions  and  other 
international  actions  and  responses,  termed  transactions.  The 

* 

McClelland  and  Hoggard,  "Conflict  Patterns  m the  Interactions 
Among  Na tion s , " USC . 1968  July  memo. 
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distinction  is  two-fold.  Event-interactions  are  sufficiently 
unusual  and/or  important  enough  so  that  they  tend  to  be  dealt 
with  outside  normally  established  international  channels. 

They  are,  as  a result,  newsworthy,  and  tend,  when  publicly 
disclosed,  to  be  reported  by  news  media.  Interactions  can  be 
classified  in  various  ways,  i.e.,  in  terms  of  types  (threats, 
visits,  comments)  or  behavior  groups  (hostile,  friendly, 
neutral) , but  they  are  always  of  such  magnitude  and  intensity 
as  to  evoke  official  responses  of  a non-routine  nature  and 
disclosure  through  media  reporting. 


Transactions,  on  the  other  hand,  are  of  a routine  character. 


They  do  not  warrant  unusual  internationol  and  governmental 
attention;  nor  do  they  tend  to  be  given  attention  by  news 
media.  Such  routine  transactions  include  regular  diplomatic 
notes  and  messages,  and  daily  memoranda  sent  back  and  forth 


between  embassies.  They  also  include  most  international  non- 


governmental communication  involving  private  citizens,  busi- 
ness organizations,  etc. 


The  diagram  which  follows  attempts  to  illustrate  the  above 


dis  tinctions 


event-interactions 


"depth"  of 
coverage 


threshold 


governmental 


. transactions 


non -governmental 


breadth  of 
coverage 
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Let  the  entire  triangle  represent  the  universe  of  international 
actions  and  responses.  Even t- i n te r a c t ions  constitute  one  part 
of  the  universe  (probably  the  smaller  part)  and  transactions 
the  balance.  It  is  important  to  note  that  the  threshold 
separating  interactions  from  transactions  is  omewhat  arbi- 
trary and  may  vary  from  source  to  source  as  a function  of  edi- 
torial policy.  For  example,  in  serving  their  constituencies, 
international  financial  media  will  tend  to  report  international 
economic  news  in  greater  "depth"  than  will  conventional  inter- 
national newspapers.  The  latter,  in  turn,  may  well  provide 
deeper  coverage  of  international  political  news.  Similarly, 
media  of  recognized  global  scope,  such  as  the  New  York  Times, 
will  tend  to  report  news  in  greater  "breadth"  (cover  more 
countries)  than  will  more  "provincial"  media,  such  as  the 
Middle  East  Journal.  Finally,  it  is  characteristic  of  most 
if  not  all  national  sources  to  "tilt"  the  threshold  (intro- 
duce biases  in  world-wide  news  coverage) , in  accord  with  their 
own  prioritized  interests  coupled  with  those  of  their  national 
constituencies.  This  characteristic  is  illustrated  below. 


Source  A (Country  A) 
threshold 


/\ 


.Source  B (Country  B) 
threshold 
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In  undertaking  multiple  source  comparison,  then,  especially 
with  the  possible  objective  of  combining  sources,  attention 
ought  to  be  paid  to  the  characteristics  and  purposes  of  the 
alternative  sources.  It  should  also  be  recognized  that  the 
true  dimensions  and  characteristics  of  the  universe  of  event- 
interactions  has  not  yet  been  established.  Therefore,  dangers 
exist  in  assuming  either  that  single  sources  represent  "good" 
samples  of  reality  or  that  combined  sources  are  necessarily 
"improved"  samples. 

Fortunately,  these  same  conditions  and  reservations  need  not 
apply  to  the  strategy  of  treating  separate  sources  as  repre- 
sentative of  distinct  points  of  view.  That  strategy,  in  fact, 
is  designed  to  exploit  the  informational  advantage  such  source 
"imperfections"  offer. 

One  of  the  objectives  of  using  multiple  sources  is  to  increase 
the  amount  of  data  available  for  analysis.  But  a key  question 
is  the  location  of  data  in  the  above  diagrams.  As  will  be 
seen  in  the  examination  of  the  various  studies , some  sources 
were  found  to  contain  greater  amounts  of  transactional  data 

higher  data  yields.  Here  the 
1 data  valuable  and  comparable, 
xample,  Hoggard's  comparison  of 
r Project  (FRIP)  and  the  New 
the  finding  that  FRIP  data  are 
ure , and  therefore  are  not  corn- 
data  found  in  the  NYT . In  fact, 
tio  of  data  in  FRIP  to  NYT  to 

2 

s.  global  sources  , he  finds 
a greater  number  of  events  re- 
ncrease  is  transactional  rather 
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than  others,  which  resulted  in 

question  is  "are  the  additiona 

and  for  what  purposes"?  For  e 

the  Foreign  Relations  Indicato 
9 

York  Times  (NYT)  resulted  in 
of  a routine  transactional  nat 
parable  with  the  interactional 

Hoggard  found  the  frequency  ra 

. , 9 ibid 

be  2 0 : : 1 . 


In  Doran's  study  of  regional  v 
that  the  regional  sources  have 
ported — but  that  most  of  the  i 
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than  interactional.  When  interactions  occur  they  are  more 
likely  to  be  picked  up  by  the  global  source.  It  can  be  held, 
then,  that  his  use  of  regional  sources  lowered  the  threshold 
in  our  diagram. 


The  Moore  comparison  of  Foreign  Broadcast  Information  Service 
( FB IS)  and  the  NYT  finds  much  routine  data  in  FBIS,  but  never- 
theless finds  that  profitable  and  meaningful  analyses  can  be 

made  as  long  as  one  is  aware  of  the  existence  of  such  routine 

4 

data.  The  same  holds  true  for  Smith's  findings  using  the 
Indian  White  Papers--they  too  include  much  data  on  routine 
diplomatic  exchanges  yet  analysis  of  the  data  results  in  find- 
ings that  are  both  interesting  and  valuable. 


This  survey  covers  nine  papers  which  report  on  studies  of 
multiple  event  data  sources  for  a variety  of  research  pur- 
poses. The  studies  and  their  principle  findings  are  summar- 
ized in  this  section.  The  concluding  section  of  this  paper 
evaluates  the  implications  oi.  these  findings  for  the  strategy 
to  be  employed  in  our  multiple  data  stream  research. 

Edward  Azar,  with  Thomas  Jukam,  James  McCormick  and  Stanley 
7 

Cohen,  compared  eight  sources  of  interaction  data.  They 
chose  two  time  period  samples  consisting  of  January,  May  and 
September  of  1956  and  1957,  and  limited  their  attention  to 
Egypt  (UAR)  as  the  actor.  They  later  expanded  the  study  to  a 
four-year  analysis  using  the  same  methods  of  comparison,  with 
Egypt  and  Israel  as  actors.  The  eight  sources  used  included 
four  American,  two  British,  one  Russian  and  one  Swiss,  the 
choices  being  based  on  the  proposition  that  this  range  of 
sources  would  more  adequately  reflect  events  since  they  repre- 
sented several  international  arenas.  In  the  preliminary  study, 

Azar  collected  all  interaction  data  on  UAR  as  an  actor,  and 
scaled  the  events  on  a five-region  scale  of  violence.  The 
scale  ranged  from  very  low  violence  (e.g.,  a nation's  legisla- 
ture voting  funds  to  support  an  international  military  organi- 
zation) to  very  high  violence  (e.g..  Nation  A launching  an 
offensive  against  Nation  B). 

The  findings  in  the  preliminary  study,  (which  are  based  on  a 
total  of  147  events  collected  with  UAR  as  initiator  and  rated  on 
the  violence  scale  scale)  noted  that  the  Middle  East  Journal  (MEJ) 
and  the  New  York  Times  Index  (NYTI)  reported  nearly  70%  of  all  the 
events  collected  (90%  in  the  four  year  study).  Concertrating 


his  analysis  on  these  two  basic  sources,  Azar  produced  two 
interesting  results.  First,  even  though  together  they  account 
for  70%  of  all  data  reported,  joint  reporting  by  the  two  (events 
that  are  covered  by  both)  represents  only  10.9%  of  the  total 
(9.7%  in  the  four-year  study).  Second,  the  NYTI  reported 
nearly  twice  as  many  events  as  the  ME J . 


There  are  several  conclusions  that  Azar  draws  from  this  study. 

An  obvious  one  is  that  due  to  the  low  overlap  in  events  covered 
by  both  sources,  the  number  of  events  would  have  beei.  less  had 
the  study  used  only  one  source.  Azar  warns  that  reliance  on 
one  source  could  yield  different  conclusions  than  an  analysis 
using  both.  Here  he  cites  his  finding  that  the  NYTI  reported 
more  violent  events  than  the  ME J ; thus,  if  one  were  to  use  only 
the  NYTI , the  resulting  analysis  would  give  a different  picture 
of  UAR's  behavior  as  an  actor  than  if  one  were  to  use  both  sources 


Both  the  preliminary  study  and  the  four-year  study  lead  Azar 
to  warn  against  utilization  of  a single  source,  especially 
for  area  studies,  and  to  emphasize  that  to  get  a more  compre- 
hensive view  of  UAR  as  an  actor  one  needs  to  use  at  least  the 
two  bas’c  sources  studied  here.  He  feels  that  reliance  on  a 
single  source  could  generate  dissimilar  conclusions  about 
UAR's  behavior  to  other  nations,  and  would  eliminate  a substan- 
tial number  of  events  that  could  be  of  theoretical  and  em- 

7 

pirical  importance  in  analyses  of  the  data. 


Also  focusing  his  attention  on  the  Middle  East  arena  is  Robert 
3 

Burrowes 1 study  comparing  nine  sources,  among  which  are  the 
Hew  York  Times  (NYT) , New  York  Times  Index  (NYTI),  Times  of 
London  (TOL),  Deadline  Data  and  Cahiers  , with  Syria,  Jordan, 


) 


Israel  and  Egypt  as  actors.  His  time  sample  consists  of  four 
two  month  periods  (January-February  1955,  1956,  1962  and  1367) 

chosen  because  they  represent  two  periods  of  relative  calm  and 
low  activity  and  two  periods  of  high  conflict  and  activity. 
Burrowes  seeks  to  answer  questions  such  as  the  following: 

(1)  What  single  source  produces  the  largest  yield  of  events? 
(Cahiers  de  1 1 Orient  Contemporai n)  (2)  What  combination  of 
sources  produces  the  largest  y i c \ d of  data  and  with  the  least 
duplication?  (Cahiers  and  NYTI) 

Another  important  question  Burrowes  is  concerned  with  has 
great  significance  for  those  planning  the  use  of  multiple 
sources:  Do  sources  differ  qualitatively  in  terms  of  the 

types  of  events,  actors,  and  targets  they  report?  Do  they 
yield  different  interpretations  of  the  "real"  world?  His 
finding  is  that  they  do.  Selective  attention  results  in  a 
source  paying  close  attention  to  events  involving  one  nation 
than  other  nations--i . e . , if  Cahiers  and  NYT  had  been  equally 
attentive  to  each  of  the  four  actor  nations,  each  source  would 
have  yielded  a similar  percentage  of  total  actions  for  each 
nation.  However,  this  is  not  the  case.  Cahiers  noticeably 
over-reported  on  Syria,  which  happens  to  be  a former  French 
Mandate,  and  under-reported  on  Israel  because  Cahiers  doesn’t 
recognize  the  existence  of  Israel  as  a state.  (The  small 
number  of  events  on  ISR  reported  by  Cahiers  were  found  under 
the  heading  "Arab-Israel  Relations").  On  the  other  hand,  the 
NYT  relatively  over-reported  actions  by  Israel.  Another  dif- 
ference found  in  reporting  by  targets  is  that  actors  in  the 
NYT,  TOL  and  Cahiers  targeted  a disproportionately  large 
number  of  events  to  the  U.S. , Britain  and  France,  respectively 
(e.g.,  events  targeted  to  Britain  made  up  60%  of  all  events 
targeted  in  TOL  to  either  the  U.S.  Britain  or  France). 

Burrowes  concludes  that  the  analyst  is  best  advised  to  use 
multiple  sources  in  the  hope  that  their  combined  yields  will 


produce  a more  accurate  composite  analysis.  However,  h 

no  assurances  that  this  method  will  result  in  combining 

strengths  rather  than  the  weaknesses  of  the  chosen  sour 
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He  also  concludes  (as  do  Doran  et  al.  ) that  "...source 
vary  greatly  in  the  "mix"  or  distribution,  of  the  events 
report  will  produce  different  results;  such  sources  are 
ously  not  yielding  equally  representative  samples  of  th 
known  universe  of  external  behavior. 
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A study  designed  to  compare  global 

was  made  by  Charles  Doran,  Robert 
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regional  data  sources 
ey  and  George  Antunes. 
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In  this  study  Doran  collected  data  from  the  Hispanic  American 

Report  and  the  Spanish  journals  Tiempo  (Mexico  City)  and 

Vis  ion  (Panama).  These  are  all  regional  sources.  He  compared 

these  data  with  the  Feierabend  study  on  political  instability 

which  used  the  global  sources  Deadline  Data  and  Yearbook  of 

* 

the  Encyclopedia  Brittanica.  The  comparison  of  the  two  data 
sets  included  examination  of  relative  distributions  of  events, 
outlining  characteristics  within  and  between  the  sets,  as  well 
as  comparing  absolute  disparities  between  them  in  order  to 
determine  whether  any  disabling  bias  is  present. 

* 

Feierabend,  I.K.  and  R.L.,  1966--  "Aggressive  Behavior  Within 

Politics,  1948-1962:  A Cross-National  Study."  Journal  of 

Conflict  Resolution.  10  (Sept)  149-179. 
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In  the  comparison  of  event  distribution  over  time,  Doran  found 
some  agreement  between  the  two  studies  concerning  the  general 
nature  of  instability  over  time.  However,  since  he  found  that 
the  regional  press  reported  a significantly  larger  number  of 
events,  Doran  hypothesizes  that  such  a disparity  suggests  that 
the  globally  oriented  press  "may  be  sporadically  sensitive  to 
instability  events  in  a given  region  focusing  attention  on  a 

2 

country  or  region  when  events  of  (special)  significance  occur." 
Then,  turning  elsewhere,  the  global  sources  leave  it  to  the 
regional  sources  to  report  the  more  day  to  day  developments. 

One  might  mention  here  that  Doran's  data  derived  from  regional 
sources  could  be  said  to  fall  within  the  McClelland  definition 
of  more  "routine"  or  "transactional"  data.  When  these  trans- 
actional u.ita  take  o.n  the  characteristics  of  interaction  data, 
they  are  then  picked  up  by  the  global  sources. 


The  conclusions  of  the  Doran  study  sustain  other  analyst's 
assertions  that  disparities  between  two  sources  and  the  use  of 
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liable  than  another.  Even 

considerable  empirical  evidence 

2 

lty  of  regional  sources," 
of  global  source  in  certain 
ic  purposes.  He  does  urge  that 
different  sources  in  a study  of 
systemically  compare  event  dis- 
biases  or  inaccuracies  exist, 
zed  and  taken  into  account, 
urces  to  gain  a more  compre- 
international  system. 
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Raymond  Smith's  comparison  of  the  New  York  Times  (NYT)  and  the 

4 

Indian  White  Papers  (IWP)  as  sources  covering  the  Sino-Indian 
border  conflict  in  1962  concludes  that,  despite  major  differ- 
ences between  the  two  sources,  they  are  both  valuable  indica- 
tors of  behavior  in  this  case.  Basically  using  the  WEIS 
system  for  interactions  coding,  Smith  uses  the  data  to  prove 
five  propositions  set  forth  by  Galtung.  These  propositions 

present  a "partial  explanation  of  the  selection  process  that 

4 

intervenes  between  the  actual  occurrence  of  world  events" 
and  their  resulting  images  that  appear  in  the  media. 

The  papers  discussed  previously  generally  conclude  that  rely- 
ing on  one  data  source  can  be  misleading  and  unreliable,  and 
that  using  several  sources  has  drawbacks  and  difficulties 
because  different  sources  can  result  in  different  conclusions. 
These  studies  hold  that  or.e  should  consider  combining  sources 
to  increase  comprehensiveness  but  view  the  results  with  cau- 
tion. Doran  does  point  out  that  different  types  of  sources 
(i.e.,  global  vs.  regional)  can  be  used  for  different  purposes, 
but  it  is  Smith  who  is  the  first  to  emphasize  that  it  may  be 
valuable  to  exploit  these  di f f e ren ce s - - that  two  sources  may 
be  variant  but  that  both  can  be  good  indicators  of  behavior 
in  different  ways. 

Specifically,  in  Smith's  study  the  NYT  is  found  to  give  more 
attention  to  American  interests  in  the  Sino-Indian  conflict 
while  the  IWP  clearly  reflect  Indian  bias  and  propanganda. 
According  to  Smith  one  would  expect  the  NYT  to  report  more 
aggressive  actions  initiated  by  China  than  by  India.  Not  only 
do  the  data  bear  this  out,  but  the  NYT  reports  China  as  having 
committed  more  aggressive  acts  overall  than  even  India  accused 
her  of  committing  in  the  IWP.  Moreover,  the  NYT  reports  that 
China  initiated  the  border  war,  while  the  IWP  report  that 
India  started  it. 
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Smith  emphasizes  these  differences  between  the  two  sources  — 
including  that  the  IWP  contain  diplomatic  notes  and  reports 
that  are  clearly  included  for  propanganda  purposes  and  reflect 
Indian  bias.*1  What  is  important  to  note  is  that  he  views  the 
difterences  as  characteristics  the  analyst  can  use  to  his 
benefit  as  long  as  these  characteristics  are  duly  noted  and 
taken  into  account  for  analysis.  Thus,  both  sources  are  good 
indicators  of  behavior  over  time--and  the  resulting  analyses, 
although  they  may  vary,  may  include  information  on  behavior 
that  can  be  valuable.  The  NYT,  then,  with  less  events  than 
IWP,  may  be  more  representative  of  a consistent  reporting  style 
given  that  its  focus  of  attention  may  reflect  American  inter- 
ests. And  the  IWP,  even  though  as  a source  it  is  clearly  bi- 
ased in  favor  of  India,  can  still  serve  as  a good  indicator 
of  behavior  as  it  did  in  this  study  of  the  Sino-Indian  border 
con  f 1 ic t . 

Two  studies  compared  the  New  York  Times  (NYT)  and  the  Times 
of  London  (TOL)  as  sources  for  event  interaction  data.  The 
first  is  a preliminary  three  month  study  by  Charles  McClelland 
and  Robert  Young8  of  the  WEIS  Project.  This  study  was  under- 
taken to  attempt  to  discover  whether  the  gains  in  data  from 
multiple  sources  would  result  in  more  reliable  and/or  in  more 
complete  information. 

The  data  employed  by  McClelland  and  Young  was  for  the  time 
sample  of  July,  August  and  September  1969.  The  comparisons 
included:  acts  initiated  by  10  nations  across  behavior  types; 

event  frequencies  reportel  in  chosen  geographic  regions;  60 
most  active  nations  by  seven  general  categories  in  incoming 
and  outgoing  event  frequencies;  and  recorded  acts  by  various 
conflict  arenas.  The  study  also  included  correlations  of 
event  data  totals. 
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McClelland  and  Young's  general  conclusion  is  that  data  from 
both  sources  are  derived  from  the  same  uni verse— the  two 
sources  give  reports  about  the  same  world  of  events.  However, 
the  data  are  not  redundant.  Rather,  it  was  found  that  the 
data  are  substantially  alike  structurally  but  reflect  differ- 
ent source  emphases  on  regions  and  conflict  arenas.  For  ex- 
ample, reporting  of  violence  was  found  to  be  patterned  almost 
identically  in  both  the  NYT  and  TOL.  But  when  the  sources 
were  analyzed  for  attention  to  specific  geographic  regions, 
the  TOL  was  found,  for  example,  to  report  more  events  on  Africa 
and  Western  Europe  than  the  NYT.  The  findings  also  show  that 
each  source  focused  attention  on  different  conflicts:  the  NYT 
reported  twice  as  many  events  on  the  Arab-Israeli  conflict 
than  did  the  TOL  and  three  times  as  many  on  the  Vietnam  con- 
flict, while  the  TOL  reported  more  events  on  the  Sino-Soviet 
relationship  than  did  the  NYT  and  five  times  as  many  events 
on  the  Nigeria-Biaf ra  war. 


Such  conclusions  bring  to  mind  the  lessons  to  be  learned  from 
Smith's  study — tint  such  differences  in  statistical  distribu- 
tions of  data  do  not  negate  the  value  of  alternative  sources. 
Rather,  these  different  findings  reveal  salient  and  exploita- 
ble characteristics  about  the  two  sources.  The  pertinence 
of  this  is  that  multiple  sources  can  and  should  be  utilized 
for  delineating  similarities  and  differences  in  perceptions  of 
behavior  and  that  indeed  this  attribute  may  be  beneficial  for 
future  analyses. 


A more  complete  study  comparing  the  NYT  and  TOL  was  completed 
in  1972  at  the  WEIS  Project.  Gary  Hill  and  Peter  Fenn  used 
these  two  sources  to  again  compare  attention  directed  to  chosen 
arenas  of  interaction  and  expanded  it  to  explore  attention  to 
specific  episodes  of  conflict  in  international  affairs  (i.e. , 
the  conflict  between  India  and  Pakistan,  the  relationship  of 
Jordan  to  the  Palestinian  Liberation  Organization  (PLO) , the 
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Middle  East  situation  and  the  conflict  in  Vietnam).  The  time 
sample  used  in  this  study  was  January  1,  1969  to  December  31, 
1971.  The  methods  were  along  the  same  lines  is  those  in  the 
McClelland  and  Young  study. 


i 


Hill  and  Fenn  found  that  the  data  from  both  sources  form  simi- 
lar  pat^  ^rns  when  compared  over  time.  Absolute  amounts  of 
reported  events  differ,  bit  patterns  of  escalation  and  de-es- 
calation and  crisis  periods  are  clearly  distinguishable  in 
both  (although  the  NYT  reports  significant  peaks  in  crises  more 
extensively  than  the  TOL) . The  authors  found  no  evidence  of 
a consistent  bias  across  the  two  sources--the  NYT  did  not  view 
Pakistan  as  more  hostile  to  India  than  uhe  TOL  viewed  this, 
or  vice  versa.  Thus  the  study  concludes  that  event  data  as 
found  in  the  NYT  and  TOL  is  essentially  conflict-indicator 
data  which  are  of  a consistent  and  comparable  nature , parti- 
cularly when  the  data  are  of  a conflict  orientation. 


A study  comparing  t».e  New  York  Tim'S  (NYT)  and  the  Foreign 
Broadcast  Informaticn  Service  (FBIS)  was  undertaken  by  Vivian 
Moore,  James  Moore,  Barbara  Hughes,  and  Don  Krysakowski. 

The  purpose  of  the  comparison  was  to  study  the  behavior  of 
Japan  in  1972  as  reported  by  the  two  sources.  The  methods 
of  analysis  used--compar isons  of  distributions,  frequencies, 
etc. --are  based  on  data  coded  according  to  the  WEIS  procedures. 

The  findings  from  the  analyses  include  the  following.  The 
frequency  of  events  across  behavior  categories  in  the  FBIS  is 
much  larger  than  in  the  NYT.  (Recalling  the  McClelland  dis- 
tinction between  interactions  and  transactions,  however,  one 
must  point  out  that  a substantial  portion  of  the  higher  FBIS 

*It  should  be  noted  that  FBIS  is  itself  a composite  report  of 
multiple  newspaper  and  broadcast  sources  and  is  therefore  not 
a unique  "primary"  source  in  the  same  sense  as,  for  example, 

the  NYT. 
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frequencies  are  accounted  for  by  inclusion  of  more  "routine 
events.  The  authors  also  found  that  FBIS  records  Japan  as 
interact  ng  with  more  targets  than  the  NYT  and  with  a somewhat 
more  even  emphasis  across  target  nations.  They  find  that  a 
problem  exists  in  the  comparability  of  these  two  sources  l' 
cause  FBIS  yields  a much  greater  number  of  events  than  the  NYT 


Independent  of  th ? higher  transactional  content  of  FBIS  data, 
it  was  found  that  with  respect  to  Japan's  focus  of  attention 
different  contusions  are  produced  by  the  two  sources.  For 
example,  FBIS  fi.rds  Japan  focusing  most  attention  (44%)  on  Asia 
and  within  Asia  most  interaction  is  with  countries  which  have 
Communist  regimes.  B’  t the  same  analysis  with  the  NYT  as  a 
source  finds  Jipan  focusing  most  attention  on  the  U.S  (42%) 
with  Asia  second  (34.9%).  However,  both  sources  do  show  an 
emphasis  of  Japan's  attention  with  Communist  nations^  Here 
one  must  remember  our  assertion  (and  that  of  Smith  s .and 
others)  that  such  differences  need  not  nullify  the  findings 
nor  discourage  use  of  data  sets.  Rather,  such  differences, 
and  similarities  as  well,  can  and  should  be  utilized  for  spe- 
cific purposes  as  long  as  the  inherent  charac  .eristics  of  the 
two  sources  are  duly  noted  and  taken  into  account. 


Another  conclusion  (and  one  which  is  also  found  in  the  study 
by  Smith4)  is  that  to  gain  a more  complete  view  of  international 
relations  requires  integration  of  data  from  an  international 
source  (NYT)  and  a regional  source  (FBIS).  It  is  held  that 
sources  within  a region  may  develop  a data  base  which  permits 
more  sensitive  indicators  to  perceive  minor  activities  pre- 
ceding important  changes  which  tend  to  be  picked  up  later  by 
global  sources.  See  also  the  Doran  study2  for  a supporting 
view  of  the  value  of  global  and  regional  sources. 


The  stuoy  also  compared  three  dyads  of  which  Japan  was  a part 
(Japan  and  the  U.S.,  Japan  and  the  Soviet  Union,  and  Japan 
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and  the  Peoples  Republic  of  China)  using  the  indicators  of 

* 

policy  style  and  relations.  The  conclusions  of  these  com- 
parisons hold  that  the  policy  style  and  relations  indicator 
values  derived  from  FBIS  are  more  positive  than  the  same  mea- 
sures based  on  the  NYT , due  in  part  to  the  hiqher  transactional 
event  content  of  FBIS.  It  was  also  found  that  the  values  of 
these  indicators  over  time  were  generally  more  stable  (had 
less  variance)  when  based  on  FBIS  data  than  on  NYT  data. 


Gary  Hoggard's  study  comparing  the  New  York  Times  (NYT)  with 

the  Foreign  Relations  Indicator  Project  of  the  State  Depart- 
9 

ment  (FRIP)  found  the  two  sources  generally  non-comparable 
because  FRIP  contains  large  amounts  of  transactional  data. 

The  project  data  file  is  based  on  communiques  between  the  State 
Department  and  its  officials  in  seven  countries,  most  of  which 
do  not  appear  to  be  of  great  interest  to  American  newspapers 
(e.g.,  Afghanistan,  Bulgaria,  Norway).  These  two  factors 
assure  that  NYT  derived  data  are  not  only  under-reported  but 
are  likely  inadequate  for  analysis.  Thus  Hoggard  finds  the 
event  yield  in  FRIP  overwhelmingly  larger  than  in  the  NYT 
.(1046:12  for  seven  nations).  However,  he  uses  this  discrepancy 
to  point  out  that  FRIP- type  sources  enable  one  to  study  ac- 
tion-response sequences  because  of  the  frequent  and  detailed 
interactions  such  sources  provide,  while,  on  the  other  hand, 
it  is  difficult  to  find  such  continuity  using  public  media 
data  in  regions  and  for  countries  which  such  media  tend  to 
ignore . 

Hoggard's  analysis  of  differential  source  coverage*  using 
the  New  York  Times  Index,  the  Asian  Recorder,  Deadline  Data  on 
World  Affairs,  and  the  Indian  White  Papers  to  study  the  1962 
Sino-Indian  border  war  is  a more  comprehensive  comparison 


Theodore  Rubin,  "International  Affairs  Indicators  for  Defense 
Decision-Making".  January  1973,  CACI 
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yielding  salient  results  that  sustain  the  conclusions  of  other 
multiple  source  comparisons.  His  purpose  was  to  assess  the 
effects  differential  source  coverage  may  have  on  conclusions 
drawn  from  the  analysis  of  interaction  data  over  a 14-month 
time  period. 

Hoggard  finds  evidence  that  the  sources  yield  different  quan- 
tities of  interaction  data,  and  that  few  of  tne  same  events 
were  reported  across  sources.  When  compared  over  time,  the 

data  showed  little  or  no  correspondence  among  the  different 

4 

sources.  (For  a similar  analysis,  see  Smith's  paper).  Some 
of  these  findings  are  extreme,  but  may  be  attributable  to  the 
vastly  different  sources  being  compared.  For  example,  23.9% 
of  the  data  appears  in  more  than  one  source  but  only  .5% 

(or  10  events)  appears  in  all  four  sources.  Also,  65.3%  of 
the  events  reported  in  the  NYTI  appear  onh,  there,  and  other 
sources  report  from  12.1%  to  15.9%  of  the  NYTI  data.  Hoggard's 

4 

findings  about  the  IWP  substantiate  those  of  Smith.  Noting 
that  IWP  contain  diplomatic  papers  which  record  routine  events, 
he  finds  that  it  is  this  source  that  has  the  highest  percent- 
age of  events  unique  to  it. 


• 4 


Hoggard  makes  two  other  points  about  his  sources:  first,  that 

in  his  estimation  Deadline  Data  is  a poor  source  since  the 
data  it  yielded  accounted  for  only  2.4%  of  the  total;  and 
second,  that  the  NYTI  and  the  Asian  Recorder  are  more  complete 
sources  since  their  reporting  accounted  for  71.4%  of  the  total 
interactions  yielded. 

The  study  finds  that  reporting  of  the  same  events  across  these 
sources  is  a small  proportion  of  the  total  interaction  reported, 
and  that  a comparison  over  time  yields  little  or  no  corres- 
pondence among  the  sources.  This  indicates  to  Hoggard  that  for 
a complete  analysis  one  needs  to  use  as  many  sources  as  possi- 
ble thereby  acquiring  a greater  amount  of  interaction  data  and 
insuring  a larger  basis  for  analysis. 
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IMPLICATIONS  OF  RESEARCH  FINDINGS 


This  survey  has  been  fruitful  in  identifying  considerations 
which  should  be  paramount  in  the  approach  to,  analysis  of, 
and  interpretation  of  findings  from  multiple  sources  of  event 
data . 

The  two  most  basic  considerations  relate  to  (1)  the  inherent 
characteristics  of  alternative  sources,  and  (2)  the  purposes 
to  which  data  are  to  be  applied.  It  is  clear  that  "event" 
data  may  be,  and  have  been,  derived  from  many  types  of  sources  — 
from  newspaper  to  White  Papers,  from  digests  and  journals  to 
diplomatic  communications.  Each  of  these  source  types  tends  to 
define  "events"  differently.  While  all  sources  report  inter- 
actions, some  are  devoid  of  transactional  events  while  others 
include,  and  indeed  even  emphasize  such  events.  Furthermore, 
source  types  differ  significantly,  with  regard  to  the  global 
vs.  regional  dimensions  of  coverage  and  emphasis. 

With  regard  to  purpose,  it  is  clear  that  the  "goodness"  of  a 
data  source  can  and  should  be  evaluated  only  in  terms  of  the 
intended  uses  of  the  data.  If  primary  interest  lies  in  maxi- 
mizing the  amount  of  data  for  research  and  analysis,  then 
different  conclusions  are  in  order  with  regard  to  source  choices 
and  combinations  than  if  interest  lies  in  exploiting  the  ex- 
isting differences  between  "pure"  or  unadulterated  sources. 

The  major  difference  in  data  quality  implied  by  these  two  clas- 
ses of  use  is  as  follows:  Enhancing  data  quantity  through  the 

use  of  multiple  sources  and/or  the  inclusion  of  transactional 
data  introduces  uncertainties  with  regard  to  data  quality,  as 
in  such  areas  as  comparability,  sample  bias,  and  reliability. 
These  uncertainties  may  easily  confound  interpretation  of  some 
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analyses,  and  may  invalidate  others  entirely.  Using  sources 
in  their  pure  form  avoids  the  introduction  of  such  possible 
pitfalls . 


In  the  forthcoming  multiple  data  stream  research,  comparative 
analysis  will  be  restricted  to  two  sources  of  the  same  type, 
specifically  the  daily  New  York  Times  and  the  Times  of  London 
Both  of  these,  of  course,  are  leading  globally  oriented  news- 
paper sources  indigenous  to  primary  Western  countries.  The 
research  will  explore  the  similarities  and  differences  in  the 
perceptions  of  international  behavior  that  these  two  sources 
report,  and  will  have  as  its  purpose  the  identification  of 
international  behaviors  which  are  prioritized  and  evaluated 
differently  by  the  two  sources. 
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Definition  and  Measurement  of  the  Relations 
and  Policy  Style  Indicators 


APPENDIX  B. 

Definition  and  Measurement  of  the  Relations 
and  Policy  Style  Indicators 


Relations  and  Policy  Style  are  indicators  of  the  quality  of 
international  interaction.  Interaction  between  a country  pair 
may  range  from  friendly  to  unfriendly  over  time,  as  it  consists 
of  a mix  of  positive,  negative  and  neutral  actions.  The  Rela- 
tions indicator  is  defined  as  the  friendly  to  unfriendly  quality 
of  actions  flowing  between  a country  pair  in  both  directions 
(i.e.,  actions  from  A to  B and  actions  from  B to  A).  Policy 
Style  is  defined  as  the  friendly  to  unfriendly  quality  of  actions 
flowing  from  one  country  to  another  (i.e.  , actions  from  A to  B)  . 

Relations  and  policy  Style  are  measured  by  the  particular  mix  of 
positive,  negative  and  neutral  actions  between  a pair  as  reported 
by  the  data  source.  Values  of  Relations  and  Policy  Style  are 
obtained  by  the  functions 


R , or  S = 


p + n + 


where 


= Relations 

= Policy  Style 

= frequency  of  positive  actions  reported, 
in  both  directions  for  R,  or  in  one  direc- 
tion for  S . 

= frequency  of  negative  actions  reported, 
in  both  directions  for  R,  or  in  one  direc- 
tion for  S . 

= frequency  of  neutral  actions  reported, 

in  both  directions  for  R,  or  in  one  direc- 
tion for  S (neutral  actions  are  accorded 
one-half  weight  in  measuring  R and  S). 


The  values  of  this  function  range  from  -rl.O  to  -1.0.  A plus 
value  of  R or  S indicates  that  positive  actions  exceed  negative 
actions,  and  therefore,  that  R or  S is  friendly;  a minus  value 
of  F or  S indicates  the  opposite.  The  magnitude  of  the  plus  or 
minus  values  of  R or  S indicates  the  degree  to  which  Relations 
or  policy  Style  are  positive  or  negative,  respectively  (i.e., 
how  friendly  or  how  unfriendly). 
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APPENDIX  C. 

Alphabetical  List  of  Country  and  Organizational  Names,  with  Abbreviations 


COUNTRY 

ABBR. 

• 

COUNTRY 

ABBR . 

Afghanistan 

AFG 

Dahomey 

DAH 

t 

* 

* 

Albania 

ALB 

Denmark 

DEN 

* 

Algeria 

ALG 

Dominican  Republic 

DOM 

1 

Andorra 

AND 

Angola 

ANG 

Ecuador 

EDU 

Argentina 

ARG 

Egypt 

EGY 

Australia 

AUL 

El  Salvador 

ELS 

s 

Austria 

AUS 

Equitorial  Guinea 

GUE 

(includes  Fernando 

Po) 

Bahrain 

BAU 

Ethiopia 

ETH 

Bangladesh 

BGD 

Barbados 

BAR 

Finland 

FIN 

1 

Belgium 

BEL 

France 

FRN 

Berlin/East 

EBA 

Fiji 

FIJ 

Berlin/West 

WBE 

; 

Bhutan 

BHU 

Gabon 

GAB 

I 

Bolivia 

BOL 

Gambia 

GAM 

Botswana 

BOT 

Germany/Dem.  Rep. 

GME 

Brazil 

BRA 

Germany/Fed.  Rep. 

GMW 

Bulgaria 

BUL 

Ghana 

GHA 

Burma 

BUR 

Greece 

GRC 

Burundi 

BUI 

Greneda 

GRE 

Guatemala 

GUA 

Cambodia 

CAM 

Guinea 

GUI 

Cameroun 

CAO 

Guinea-Bissau 

GBI 

Canada 

CAN 

Guyana 

GUY 

Central  African 

CEN 

Republic 

Haiti 

HA  I 

Chad 

CHA 

Honduras 

HON 

Chile 

CHL 

Hungary 

HUN 

China,  People's 

CHN 

Republic  of 

Iceland 

ICE 

China,  Republic  of 

CUT 

India 

IND 

Columbia 

COL 

Indonesia 

INS 

Congo 

COP 

Iran 

IRN 

(Brassaville) 

Iraq 

IRQ 

Congo 

ZAI 

Ireland 

IRE 

Costa  Rica 

COS 

Israel 

ISR 

Cuba 

CUB 

Italy 

ITA 

Cyprus 

CYP 

Ivory  Coast 

I VO 

Czechoslovakia 

CZE 

L 


l ) 


B 


0 


COUNTRY 

ABBR. 

COUNTRY 

ABBR 

Jamaica 

JAM 

Rhodesia 

RHO 

Japan 

JAP 

Ruman i a 

RUM 

Jordon 

JOR 

Rwanda 

RWA 

Kenya 

KEN 

San  Marino 

SAN 

Korea/North 

KON 

Saudi  Arabia 

SAU 

Korea/South 

KOS 

Senega  1 

SEN 

Kuwai t 

KUW 

Sierra  Leone 

SIE 

S in  gapo  r e 

SIN 

Laos 

LAO 

Somal i a 

SOM 

Lebanon 

LEB 

South  Africa 

SAF 

Lesotho 

LES 

South  Yemen 

SYE 

L i b e r i a 

LIB 

Spa  i n 

SPN 

Libya 

LB  Y 

Sri  Lanka  (Ceylon) 

SRI 

Liechtenstein 

LIC 

Sudan 

SUD 

Luxemburg 

LUX 

Swazi land 

SWA 

Sweden 

SWD 

Malagasy 

MAG 

Switzerland 

SWZ 

Malawi 

MAW 

Syria 

SYR 

Malaysia 

MAL 

Maidive 

MAD 

Tanzania 

TAZ 

Mali 

MLI 

Tha i 1 a nd 

TAI 

Malta 

MLT 

Togo 

TOG 

Mauritius 

MAR 

Trinidad- Tobago 

TRI 

Mauri tania 

MAU 

Tunisia 

TUN 

Mexico 

MEX 

Turkey 

TUR 

Monaco 

MOC 

Mongolia 

MON 

Uganda 

UGA 

Morocco 

MOR 

USSR 

US  R 

Mozambique 

MOZ 

United  Arab  Emirates 

UAE 

Muscat  and  Oman 

MOM 

United  Kingdom 

UNK 

USA 

USA 

Nauru 

NAU 

Upper  Volta 

UPP 

Nepal 

NEP 

Uruguay 

URU 

Netherlands 

NTH 

New  Zealand 

NEW 

Vatican 

VAT 

N icaragua 

NIC 

Vene  zue la 

VEN 

Niger 

N I R 

Vietnam/North 

VTN 

Nigeria 

NIG 

\ ietnam/South 

VTS 

Norway 

NOR 

Western  Samoa 

WSM 

Pakistan 

PAK 

Panama 

PAN 

Yeme  n 

YEM 

Papua  New  Guinea 

PNG 

Yugos 1 a via 

YUG 

Paraguay 

PAR 

Peru 

PER 

Zamb  i a 

SAM 

Philippines 

PHI 

Poland 

POL 

Colonies  or  Protectorates 

Portugal 

POR 

Bahamas  ( B R . ) 

BAS 

Qatar 

QAT 

Bermuda  ( BR . ) 

BER 

C-2 


y 

il 

■i 


i- 


J 


COUNTRY 


ABBR. 


British  Honduras 

BHO 

French  Guiana 

FGU 

Hong  Kong 

HOK 

Macao  (Portugal) 

MAC 

Southwest  Africa 

SAW 

Spanish  Sahara 

SPS 

Alliance  for  Progress 
Organization  of  American  States 
Irish  Republic  Army 
Warsaw  Pact 

North  Atlantic  Treaty  Organization  (NATO) 
European  Economic  Community 
European  Free  Trade  Association 
United  Nations  (only) 

Organization  for  African  Unity 
Kurds 

Palestine  Liberation  Organization 

Arab  Leayue 

Vietcong 

World  Bank  (IBRD,  IDA) 

International  Monetary  Fund 

International  terrorist  groups 

Southeast  Asia  Treaty  Organization  (SEATO) 

International  Red  Cross 

All  other  international  organizations 

Any  other  multilateral  group 

Not  stated,  unidentified  target 


AFP 

CAS 

IRA 

WAR 

NAT 

EEC 

EFT 

UNO 

OAU 

KUR 

PLO 

ARL 

VCG 

WBK 

IMF 

TER 

SEA 

IRC 

I NT 

MLG 

NSC 


